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ABSTRACT 

In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP ' s 
history, voluntary state-by-state assessments were made. In 1992, the NAEP 
Program included an expanded TSA in fourth-grade reading. The 1992 reading 
assessment considered students 1 performance in situations that involved 
reading different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Alabama, 2,571 students in 105 
public schools were assessed. This report describes the reading proficiency 
of Alabama fourth-graders and compares their overall performance to students 
in the Southeast region of the United States and the nation (using data from 
the NAEP national assessments) . The distribution of reading results and 
reading achievement level results are provided for subpopulations of students 
(race/ethnicity, type of location, parents' educational level, and gender, 
and performance according to purpose for reading) . To provide a context for 
the assessment data, participating public school students, their reading 
teachers, and principals completed questionnaires which focused on: policies 
and practices related to reading (time for instructional activities and 
instructional resources for reading) ; delivery of reading instruction 
(instructional materials and activities, workbooks/worksheets/writing, 
discussion and group activities, time to read, reading and use of libraries, 
assessing progress in reading) ; reading instructors (preparation, experience 
and professional development); students' home support for literacy (reading 
outside of school and in the home and hours of television watched per day) . 
The average reading proficiency of fourth-grade public school students in 
Alabama on the NAEP reading scale was 208 conpaased to 216 nationwide. (SR) 
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INTRODUCTION 
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REPORT 
CARD 

1992 

Trial State Asaeument 




The National Assessment of Educational Progress (NAEP) is a Congressionally mandated 
project of the National Center for Education Statistics (NCES) that has collected and 
reported information for nearly 25 years on what American students know and what they 
can do. It is the nation’s only ongoing, comparable, and representative assessment of 
student achievement. Its assessments are given to scientifically selected samples of youths 
attending both public and private schools and enrolled in grades four, eight, or twelve. The 
assessment questions are written around a framework prepared for each content area — 
reading, writing, mathematics, science, and others — that represents the consensus of groups 
of curriculum experts, educators, members of the general public, and user groups on what 
should be covered on such an assessment. Reporting includes means and distributions of 
scores, as well as more descriptive information about the meaning of the data. 



New Reading Assessment Framework and Questions 



The goal of the National Center for Education Statistics is to make data available for the 
public and to do so in accurate and understandable ways that are not misleading. The task 
is challenging because much of what matters in NAEP is changing: 



• the content in response to the developing standards of various curricular 
groups; 

• the assessment questions in response to new developments in assessments; 
and 

• the reporting in response to increasing interest in student achievement 
relative to standards of student performance. 
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The framework for the 1992 Trial State Assessment Program in reading considered 
students’ performance in situations that involved reading different kinds of materials for 
different purposes. The fourth-grade reading assessment measured two global purposes for 
reading — reading for literary experience and reading to gain information. (The eighth- and 
twelfth-grade national NAEP reading assessments also measured a third purpose for 
reading — reading to perform a task.) Reading for literary experience usually involves the 
reading of novels, short stories, plays, and essays. In these reading situations, the reader 
can determine how the author explores or uncovers experiences through the text and 
considers the interplay among events, emotions, and possibilities. Reading to gain 
information usually involves the reading of articles in magazines and newspapers, chapters 
in a textbook, entries in encyclopedias and catalogs, and entire books on particular topics. 
These reading situations call for different orientations to text from those in reading for 
literary experience because readers are specifically focused on acquiring information. 

The assessment asks students to build, extend, and examine text meaning from four stances 
or orientations: 

♦ Initial Understanding — comprehending the overall or general meaning of 
the selection. 

♦ Developing an Interpretation - extending the ideas in the text by making 
inferences and connections. 

♦ Personal Response - making explicit connections between ideas in the text 
and a student’s own background knowledge and experiences. 

♦ Critical Stance — considering how the author crafted a text. 

These stances are not considered hierarchical or completely independent of each other, but 
are iterative. They provide a frame for generating questions and considering student 
performance at all levels. 

The 1992 NAEP reading assessment uses a variety of innovative assessment approaches 
that are considered significant advancements over previous assessments. In addition to 
multiple-choice questions, the assessment primarily includes constructed-response 
questions that ask students to demonstrate comprehension beyond a surface level. Also, 
longer and naturally-occurring reading materials are used to provide more realistic reading 
experiences than in previous assessments. 

Taken together, the changes in the 1992 reading framework and assessment activities 
preclude any comparisons between the results in this report and those for previous NAEP 
reading assessments. If the current NAEP framework is used in the future, as planned in 
the 1994 assessment, the 1992 reading data will supply the basis for a trend report. 
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A Transition in Reporting 

Over time there have been many changes in emphasis of NAEP reporting, both to take 
advantage of new technologies and to reflect changing trends in education. In 1984, a new 
technology called Item Response Theory (IRT) made it possible to create “scale scores” 
for NAEP similar to those the public was accustomed to seeing for the annual Scholastic 
Aptitude Test (SAT). Educational Testing Service, in its role as Government grantee 
carrying out NAEP operations, devised a new way to describe performance against this 
scale, called “anchor levels.” Starting in 1984, NAEP results were reported by “anchor 
levels.” Anchor levels describe distributions of performance at selected points along the 
NAEP scale (i.e., standard deviation units). Anchor levels show how groups of students 
perform relative to each other, but not whether this performance is adequate. 

In 1988, Congress established the National Assessment Governing Board (NAGB), 
assigning it broad policy making authority over NAEP, including the authority to take 
“appropriate actions ... to improve the form and use of the National Assessment” and to 
identify “appropriate achievement goals for each . . . grade and subject area to be tested in 
the National Assessment.” To carry out its responsibilities, NAGB developed 
“achievement levels,” which are collective judgments about how students should perform 
relative to a body of content reflected in the NAEP frameworks. The result is translated 
onto ranges along the NAEP scale. For the 1992 reading assessment, this process was 
conducted for NAGB under contract by American College Testing (ACT), which has 
extensive experience in standard-setting in many fields. 

With this background, the initial reports for the 1992 reading assessment mark NCES’s 
continued attempt to shift to standards-based reporting of National Assessment statistics. 
The first transition to reporting NAEP results by achievement levels was for the NAEP 
1992 Trial State Assessment in mathematics. 1 The impetus for this transition lies in the 
belief that NAEP data will take on more meaning for the public if they show what 
proportion of our youth are able to meet judgmental standards of performance. 

Reporting NAEP results on the basis of achievement levels represents a significant change 
in practice for NCES. On occasion, this agency makes use of emerging analytical 
approaches that permit new, and sometimes controversial, analyses to be done. When 
doing so, this agency, just as other statistical agencies do when introducing new measures 
to supplement or replace old measures, also has provided the data according to the earlier 
procedures in addition to the new ones. In the case of the 1992 mathematics assessment, 
for example, the “anchor levels” or “scale anchoring” method of reporting was presented 
in an appendix. 



1 For a summary of the 1992 assessment of mathematics, see NAEP 1992 Mathematics Report Card for the 
Nation and the States. (Washington, DC: National Center for Education Statistics, 1993) and the individual 
1992 Mathematics State Reports. 
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In this assessment, the “scale anchoring” methodology used by NAEP since 1985 has been 
used but in a new way. As implemented for this report, the scale anchoring process applies 
not to regular scale intervals (standard deviation units), but to the achievement levels 
established for fourth-grade students. 2 The details of this procedure are presented in 
Appendix D. The critical distinction here is that setting achievement levels attempts to 
describe what students should be able to do in various ranges of the NAEP scale while the 
anchoring procedure attempts to describe what they can do at those achievement levels 
using actual student performance data from the NAEP assessments. 

Chapter 1 of this report describes how the 1992 standards were prepared and provides 
examples of assessment questions that illustrate the reading content reflected in the 
descriptions of the NAEP achievement levels. Chapters 1 - 6 include information on 
overall means, distributions of reading proficiency, as well as background questionnaire 
data, all taken directly from the results of the assessment questions. 

Continuing Development Effort 

We believe that the numerous completed and ongoing studies 3 will lead to national debate 
that can assure the public is well informed about these issues — as informed they must be 
because the results will be a vital influence on what Americans come to think about the 
condition and progress of our schools. Indeed, measures of student learning may be as 
significant bases for public understanding about our nation’s education system as the 
Consumer Price Index and the monthly unemployment statistics are in informing the 
public about our nation’s economy. 

In addition, members of the public need the data in this report to see for themselves what 
standards-based reporting might do and to evaluate the often conflicting claims of adherents 
and detractors of these changes in approaches to reporting on the educational achievement 
of American students. Reporting NAEP results to the public would be more clear if the 
language of the achievement levels, or standards, could also directly describe what students 
know and can do. In order to accomplish that, the frameworks, assessment questions, and 
achievement levels may need to be developed in tandem. That is easier to say than to do, 
however, because it implies a substantially larger pool of assessment questions, carefully 
designed to support reporting about performance relative to a set of performance standards. 
Clearly this is a developmental effort that will take time and several iterations, during which 
data supporting appropriate inferences about the performance of American students will 
be gathered on a continuing basis. 



2 First, students were identified who performed at or around the three achievement levels on the scale (212, 243, 
and 275). Next, questions were identified that were answered correctly by 65 percent or more of the 
fourth-grade students at the cutpoint for that achievement level. Finally, reading educators were asked to 
analyze each anchor-level question and create summary descriptions of the skills and abilities evidenced by 
students who answered these sets of questions successfully. 



3 Educational Achievement Standards: Setting Achievement Levels for the Nation. The Second Report of the 
National Academy of Education Panel on the Evaluation of the NAEP Trial State Assessment: 1992 Trial 
State Assessment . (Stanford, CA: National Academy of Education, 1993).; U.S. General Accounting Office 
(GAO). Educational Achievement Standards: NAGB's Approach Yields Misleading Interpretations. June 
1993. GAO/PEMD-93-12.; Assessing Student Achievement in the States . The First Report of the National 
Academy of Education Panel on the Evaluation of the NAEP Trial State Assessment: 1990 Trial State 
Assessment. (Stanford, CA: National Academy of Education, 1992).; R.L. Linn, D.M. Koretz, E.L. Baker, 
and L. Burstein. The Validity and Credibility of the Achievement Levels for the 1990 National Assessment of 
Educational Progress in Mathematics. (Los Angeles, CA: Center for Research on Evaluation, Standards, and 
Student Testing, UCLA, June 1991) CRESST Report 330. 
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A Recent History of NAEP 

In 1988, Congress passed new legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State Assessment 
Program in which public-school students in 37 states, the District of Columbia, and two 
territories were assessed in eighth-grade mathematics. 4 The 1992 NAEP program included 
an expanded Trial State Assessment Program in fourth-grade reading and fourth- and 
eighth-grade mathematics, with public-school students assessed in 41 states, the District of 
Columbia, and two territories. 5 In addition, national assessments in mathematics, reading, 
writing, and science were conducted concurrently with the Trial State Assessment Program 
in 1990 and in 1992. 

School and Student Participation in the Reading Assessment 

In Alabama, 105 public schools participated in the fourth-grade reading assessment. The 
weighted school participation rate was 97 percent, which means that the fourth-grade 
students in this sample of schools were directly representative of 97 percent of all the 
fourth-grade public- school students in Alabama. 



4 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. 
Phillips. The State of Mathematics Achievement: NAEP's 1990 Assessment of the Nation and the Trial 
Assessment of the States . (Washington, DC: National Center for Education Statistics, 1991). 

5 For a summary of the 1992 assessment of mathematics, see NAEP 1992 Mathematics Report Card for the 
Nation and the States. (Washington, DC: National Center for Education Statistics, 1993). 
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In total, 2,571 fourth-grade Alabama public-school students were assessed. The weighted 
student participation rate was 96 percent. This means that the sample of students who 
took part in the assessment was directly representative of 96 percent of the eligible 
fourth-grade public-school student population in participating schools in Alabama (that is, 
all students from the population represented by the participating schools, minus those 
students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 93 percent. This 
means that the sample of students who participated in the assessment was directly 
representative of 93 percent of the eligible fourth-grade public-school student population 
in Alabama. 



Students’ Reading Performance 



As shown in the following figure, the overall average proficiency of fourth-grade 
public-school students from Alabama on the NAEP reading scale was 208. This 
proficiency was lower than that of students across the nation (2 16). 6 There also was a 
tremendous range in student performance. The lowest performing 10 percent of the fourth 
graders from Alabama had proficiency levels below 160 while the top 10 percent of the 
fourth graders had proficiency levels above 253. 

THE I 
REPORT 

Fourth-Grade Public-School Students’ CARD 

Average Reading Proficiency 

1992 

Trial State Assessment 





The NAEP reading scale ranges from 0 to 500. The standard errors are presented in parentheses. With about 
95 percent confidence, the average reading proficiency for each population of interest is within ± 2 standard 
errors of the estimated mean (95 percent confidence interval, denoted by h-H). If the confidence intervals for 
the populations do not overlap, there is a statistically significant difference between the populations. If they do 
overlap, the difference may or may not be statistically significant. Statistical tests comparing the two estimates 
must be conducted that use the standard error of the difference (see Appendix A for details). 



6 Differences reported as significant are statistically different at the 95 percent confidence level. This means that 
with 95 percent confidence there is a real difference in the average reading proficiency between the two 
populations of interest. “About the same” means that no statistically significant difference was found at the 
95 percent confidence level. 
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LEVELS OF ACHIEVEMENT 

When Congress established the National Assessment Governing Board (NAGB) in 1988 
to set policy for NAEP, it charged the board with “identifying appropriate achievement 
goals for each age and grade in each subject area to be tested under the National 
Assessment.” (Pub. L. 297-100 Section 3403 (a)(5)(B)(ii)). 

NAGB developed three achievement levels for each grade -- Basic, Proficient, and 
Advanced. Performance at the Basic level denotes partial mastery of the knowledge and 
skills that are fundamental for proficient work at each grade level. The central level, called 
Proficient, represents solid academic performance at each grade level tested. Students 
reaching this level demonstrate competency over challenging subject matter and are well 
prepared for the next level of schooling. Achievement at the Advanced level signifies 
superior performance at the grade tested. Definitions of the three levels of reading 
achievement are given below. 



■ : t BASIC ! 


Fourth-grade students performing at the Basic level should demonstrate an 
understanding of the overall meaning of what they read. When reading texts 
appropriate for fourth graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 


PROFICIENT 


Fourth-grade students performing at the Proficient level should be able to 
demonstrate an overall understanding of the text, providing inferential as well 
as literal information. When reading text appropriate to fourth grade, they 
should be able to extend the ideas in the text by making inferences, drawing 
conclusions, and making connections to their own experiences. The connection 
between the text and what the student infers should be clear. 


ADVANCED 

(275) 


Fourth-grade students performing at the Advanced level should be able to 
generalize about topics in the reading selection and demonstrate an awareness 
of how authors compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge texts critically and, in 
general, give thorough answers that indicate careful thought. 



Because the process of setting the levels of reading achievement centered on the descriptions 
of what students should be able to do, it is important to explore whether students actually 
met the expectations for performance at the Basic, Proficient, and Advanced levels. To 
help in this process, NCES arranged for ETS to apply a modified anchoring procedure to 
the 1992 reading achievement levels. A committee of reading education experts was 
assembled to review the questions and assessment results. Using their knowledge of reading 
and student performance on the individual questions, the committee members were asked 
to summarize student performance at each achievement level (see Appendix D for more 
details on the anchoring procedure). 

Placing the descriptions of how students performed at each of the levels in the context of 
the expectations for achievement at each of the levels and cross-checking with the actual 
question-by-question results yields some interesting findings. In general, the sets of reading 
skills expected were those observed. However, in some instances, particularly for extended 
response questions, even Advanced-level students had difficulty providing in-depth answers. 
In some other instances, because the assessment was developed prior to the achievement 
level descriptions, particular reading skills were not measured. For more information about 
student performance, see the full report. 
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The following figure provides the percentage of students at or above each achievement 
level, as well as the percentage of students below the Basic level. In Alabama, 48 percent 
of the fourth graders in public schools were at or above the Basic level, 17 percent were 
at or above the Proficient level, and 2 percent were at or above the Advanced level. 
Nationwide, 57 percent of the fourth graders were at or above the Basic level, 24 percent 
were at or above the Proficient level, and 4 percent were at or above the Advanced level. 
A smaller percentage of students in Alabama than across the nation were at or above the 
Proficient level. 
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PERCENT 

The standard errors are presented in parentheses. With about 95 percent confidence, the 
average reading proficiency for each population of interest is within ± 2 standard errors of 
the estimated mean (95 percent confidence interval, denoted by HH). If the confidence 
intervals for the populations do not overlap, there is a statistically significant difference 
between the populations. If they do overlap, the difference may or may not be statistically 
significant. Statistical tests comparing the two estimates must be conducted that use the 
standard error of the difference (see Appendix A for details). 
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PERFORMANCE ACCORDING TO PURPOSE FOR READING 

The 1992 Trial State Assessment Program considered students’ performance in situations 
that involved reading different kinds of materials for different purposes. The fourth-grade 
reading assessment measured two global purposes for reading -- reading for literary 
experience and reading to gain information. Students in Alabama performed lower than 
students across the nation in reading for literary experience and to gain information. 



Subpopulation Performance 



Assessment results repeatedly show differences in achievement for subpopulations of 
students. 7 The 1992 Trial State Assessment provides additional information about the 
achievement of important subpopulations by reporting on the performance of various 
subgroups of the student population defined by race/ethnicity, type of community, parents’ 
education level, and gender. 



Race! Ethnicity 



White students in Alabama demonstrated higher average reading proficiency than 
did Black or Hispanic students. In Alabama, about one quarter of the White 
students (24 percent), relatively few of the Black students (4 percent), and 
relatively few of the Hispanic students (6 percent) were at or above the Proficient 
level. Across the nation, about one quarter of the White students (30 percent), 
relatively few of the Black students (7 percent), and some of the Hispanic students 
(12 percent) were at or above the Proficient level. 



Type of Community 



The average reading performance of Alabama students attending schools in 
advantaged urban areas was higher than that of students attending schools in 
disadvantaged urban areas, extreme rural areas, or areas classified as “other”. Less 
than half of the students attending schools in advantaged urban areas (32 percent), 
relatively few of the students in disadvantaged urban areas (5 percent), some of the 
students in extreme rural areas (18 percent), and some of the students in areas 
classified as “other” (18 percent) in Alabama were at or above the Proficient level. 
Across the nation, about half of the students in advantaged urban areas 
(47 percent), relatively few of the students in disadvantaged urban areas 
(5 percent), about one quarter of the students in extreme rural areas (24 percent), 
and about one quarter of the students in areas classified as “other” (24 percent) 
were at or above the Proficient level. 



7 Ina V.S. Mullis, John A. Dossey, Mary A. Foertsch, Lee R. Jones, and Claudia A. Gentile. Trends in 
Academic Progress. (Washington, DC: National Center for Education Statistics, 1992). 
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Parents' Education 



Students in Alabama who reported that at least one parent graduated from college 
demonstrated about the same average reading proficiency as did students who 
reported that at least one parent had some education after high school or at least 
one parent graduated from high school, but higher proficiency than did students 
who reported that neither parent graduated from high school or they did not know 
their parents’ education level. Reading achievement in Alabama was at or above 
the Proficient level for 24 percent of the students who reported that at least one 
parent graduated from college, 25 percent of the students who reported that at 
least one parent had some education after high school, 14 percent of the students 
who reported that at least one parent graduated from high school, 8 percent of the 
students who reported that neither parent graduated from high school, and 
11 percent of the students who reported that they did not know their parents’ 
education level. Across the nation, these figures were 33 percent of the students 
who reported that at least one parent graduated from college, 28 percent of the 
students who reported that at least one parent had some education after high 
school, 18 percent of the students who reported that at least one parent graduated 
from high school, 10 percent of the students who reported that neither parent 
graduated from high school, and 17 percent of the students who reported that they 
did not know their parents’ education level. 



Gender 



In Alabama, fourth-grade boys attending public schools had a lower average 
reading proficiency than did fourth-grade girls. Compared to the national results, 
girls in Alabama performed lower than girls across the country; boys in Alabama 
performed lower than boys across the country. There was a significant difference 
between the percentages of males and females in Alabama who attained the 
Proficient level (20 percent for females and 14 percent for males). The percentage 
of females in Alabama who attained the Proficient level was lower than the 
percentage of females in the nation who attained the Proficient level (20 percent 
for Alabama and 26 percent for the nation). Similarly, the percentage of males in 
Alabama who attained the Proficient level was lower than the percentage of males 
in the nation who attained the Proficient level (14 percent for Alabama and 
21 percent for the nation). 



A Context for Understanding Students’ Reading Proficiency 

Information on the reading performance of students in Alabama can be better understood 
and used for improving instruction and setting policy when supplemented with contextual 
information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 1992 Trial 
State Assessment, their reading teachers, and the principals or other administrators in their 
schools were asked to complete questionnaires on policies, instruction, and programs. The 
student, teacher, and school data help to describe some of the current practices and 
emphases in reading education, illuminate some of the factors that appear to be related to 
fourth-grade public- school students’ reading proficiency, and provide an educational 
context for understanding information on student achievement. Highlights of the results 
for the public- school students in Alabama are as follows: 
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CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• In Alabama, 88 percent of the fourth-grade students had reading teachers 
who spent at least 60 minutes providing reading instruction each day . By 
comparison, 12 percent of the students had reading teachers who spent 
45 minutes or less providing reading instruction each day. 

• In Alabama, some of the fourth-grade students (18 percent) were being 
taught by teachers who placed heavy emphasis on phonics; about half 
(47 percent) were being taught by teachers who placed heavy emphasis on 
the integration of reading and writing; and about one quarter (30 percent) 
were being taught by teachers who placed heavy emphasis on the whole 
language approach. 

• In addition, in Alabama, less than half of the fourth-grade students 
(32 percent) were being taught by teachers who placed heavy emphasis on 
literature-based reading; about half (46 percent) were being taught by 
teachers who placed heavy emphasis on reading across the content areas, 
and some (14 percent) were being taught by teachers who placed heavy 
emphasis on individualized reading programs. 



DELIVERY OF READING INSTRUCTION 



• Less than half of the fourth-grade public-school students in Alabama 
(38 percent) had reading teachers who used both basal and trade books, 
more than half (58 percent) had reading teachers who primarily used basal 
readers, and relatively few (2 percent) had reading teachers who primarily 
used trade books. 

• In Alabama, 1 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines almost every day; 
19 percent of the students had reading teachers who used reading kits 
almost every day; 6 percent had reading teachers who used computer 
software for reading instruction almost every day; 29 percent had reading 
teachers who used a variety of books almost every day; and, finally, 
32 percent had teachers who used materials from other subject areas 
almost every day. 

• In Alabama, about one quarter of the fourth-grade students (26 percent) 
had reading teachers who devoted almost all of their instructional time in 
reading to teaching decoding skills; less than half of the students 
(33 percent) had reading teachers who devoted almost all of their 
instructional time in reading to oral reading; about half (47 percent) had 
reading teachers who devoted almost all of their instructional time in 
reading to teaching vocabulary; more than half (57 percent) had reading 
teachers who devoted almost all of their instructional time in reading to 
comprehension/interpretation; and finally, less than half (35 percent) had 
teachers who devoted almost all of their instructional time in reading to 
reading strategies. 
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EDUCATIONAL BACKGROUND OF TEACHERS 

• In Alabama, 60 percent of the students were being taught by reading 
teachers who reported having at least a master’s or education specialist’s 
degree. This compares with 46 percent for students across the nation. 

• Some of the students (19 percent) had reading teachers who had the 
highest level of teaching certification that is recognized by Alabama. This 
is lower than the figure for the nation, where more than half of the students 
(57 percent) were taught by reading teachers who were certified at the 
highest level available in their states. 

• In Alabama, 19 percent of the fourth-grade public-school students were 
being taught reading by teachers who had an undergraduate major in 
English, reading, and/or language arts. By comparison, 22 percent of the 
students across the nation had reading teachers with the same major. 

HOME FACTORS 

• Students in Alabama who had four types of reading materials in the home 
(newspapers, magazines, more than 25 books, and an encyclopedia) 
showed a higher reading proficiency than did students with zero to two 
types of materials. Across the nation, students who had all four types of 
materials at home showed a higher reading proficiency than did students 
who had zero to two types. 

• In Alabama, 30 percent of the fourth-grade public-school students 
discussed what they read with friends or family almost every day; 
24 percent never or hardly ever discussed what they read. Across the 
nation, 27 percent discussed what they read with friends or family almost 
every day and 24 percent never or hardly ever discussed what they read. 

• Some of the fourth-grade public-school students in Alabama (16 percent) 
watched one hour or less of television each day; about one quarter 
(26 percent) watched six hours or more. 



Comparisons of Overall Reading Proficiency in Alabama with Other 
States 

The map on the following page provides a method for making appropriate comparisons 
of the overall reading proficiency in Alabama with that in other states (including the 
District of Columbia and one territory) that participated in the NAEP 1992 Trial State 
Assessment Program. The different shadings of the states on the map show whether the 
average overall proficiency in the other states was statistically different from or not 
statistically different from that in Alabama (“Target State”). States with a dark-colored 
shading have a significantly higher average proficiency than does Alabama. States with a 
light-colored shading have a significantly lower average proficiency than does Alabama. 
States without shading have an average proficiency that does not differ significantly from 
that of Alabama. The significance tests are based on a Bonferroni procedure for multiple 
comparisons that holds the probability of erroneously declaring the means of any two states 
to be different, when they are not, to no more than five percent. 
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Trial State Assessment 



In 1988, Congress passed new legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by- state assessments on a trial basis: 

The National Assessment shall develop a trial mathematics assessment survey 
instrument for the eighth grade and shall conduct a demonstration of the 
instrument in 1990 in States which wish to participate, with the purpose of 
determining whether such an assessment yields valid, reliable State representative 
data. (Section 406(i)(2)(C)(i) of the General Education Provisions Act, as 
amended by Pub. L. 100-297 (U.S.C. 1221e-l (i)(2)(c)(i))) 

The National Assessment shall conduct a trial mathematics assessment for the 
fourth and eighth grades in 1992 and, pursuant to subparagraph (6)(D), shall 
develop a trial reading assessment to be administered in 1992 for the fourth grade 
in States which wish to participate, with the purpose of determining whether such 
an assessment yields valid, reliable State representative data. (Section 
406(i)(2)(C)(i) of the General Education Provisions Act, as amended by Pub. 

L. 100-297 (U.S.C. 1221e-l(i)(2)(c)(ii))) 

As a result of the legislation, the 1990 NAEP program included a Trial State Assessment 
Program in which public-school students in 37 states, the District of Columbia, and two 
territories were assessed in eighth-grade mathematics. 8 The 1992 NAEP program included 
an expanded Trial State Assessment Program in fourth-grade reading and fourth- and 
eighth-grade mathematics, with public-school students assessed in 41 states, the District of 
Columbia, and two territories. 9 In addition, national assessments in mathematics, reading, 
writing, and science were conducted concurrently with the Trial State Assessment Program 
in 1990 and in 1992. 



8 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. 
Phillips. The State of Mathematics Achievement: NAEP's 1990 Assessment of the Nation and the Trial 
Assessment of the States. (Washington, DC: National Center for Education Statistics, 1991). 

9 For a summary of the 1992 assessment of mathematics, see NAEP 1992 Mathematics Report Card for the 
Nation and the States. (Washington, DC: National Center for Education Statistics, 1993). 
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The 1992 Trial State Assessment Program was conducted in February 1992 with the 
following 44 participants: 



Alabama 
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* The Virgin Islands participated in the testing portion of the 1992 Trial State Assessment Program. However, 
in accordance with the legislation providing for participants to review and give permission for release of their 
results, the Virgin Islands chose not to release their results at grade 4 in the reports. 



States in regular type did not participate in the 1990 Trial State Assessment. Three states 
-- Montana, Illinois, and Oregon - participated in the 1990 Trial State Assessment but not 
in the 1992 program. 

For the 1992 Trial State Assessment in reading, approximately 2,500 students were assessed 
in each jurisdiction. The samples were carefully designed to represent the fourth -grade 
public-school populations in the states or territories. Similar to the 1990 program, local 
school district personnel administered all assessment sessions, and the contractor’s staff 
monitored 50 percent of the sessions as part of the quality assurance program designed to 
ensure that the sessions were conducted uniformly. The results of the monitoring in 1990 
and 1992 indicated a high degree of quality and uniformity across sessions. 

The 1992 Trial State and National Assessment programs in reading were based on a 
framework developed through a national consensus process that was set forth by law and 
called for “active participation of teachers, curriculum specialists, subject matter specialists, 
local school administrators, parents, and members of the general public” (Public Law 
100-297, Part C, 1988). 10 



10 Reading Framework for the 1992 National Assessment of Educational Progress. (Washington, DC: National 
Assessment Governing Board, U.S. Department of Education, 1992). 
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The process of developing the framework was carried out in late 1989 and early 1990 by 
the Council of Chief State School Officers (CCSSO) under contract from the National 
Assessment Governing Board (NAGB) which is responsible for formulating policy for 
NAEP, including developing assessment objectives and test specifications. The framework 
development process included input from a wide range of people in the fields of reading 
and assessment, from school teachers and administrators to state coordinators of reading 
and reading assessment. After thorough discussion and some amendment, the framework 
was adopted by NAGB in March 1990. An overview of the reading framework is provided 
in the Procedural Appendix. 

The fourth-grade Trial State and National Assessments in reading included eight sections 
or blocks, each 25 minutes in length. Each block consisted of a passage and a combination 
of constructed-response and multiple-choice questions. Passages selected for the 
assessment were drawn from authentic texts used by students in real, everyday reading. 
Whole stories, articles, or sections of textbooks were used, rather than excerpts or 
abridgements. The type of question — constructed-response or multiple-choice — was 
determined by the nature of the task. In addition, the constructed-response questions were 
of two types: regular constructed-response questions required students to respond to a 
question in a few words or a few sentences while extended constructed-response questions 
required students to respond to a question in a paragraph or more. 



This Report 



This is a computer-generated report that describes the reading performance of fourth-grade 
public- school students in Alabama, in the Southeast region, and across the nation. A 
separate report describes additional fourth-grade reading assessment results for the nation 
and the states, as well as the national results for grades 8 and 12. 11 This report consists 
of three sections: 

• This Overview provides background information about the Trial State 
Assessment and a profile of the fourth-grade public-school students in 
Alabama. 

• Part One describes the reading performance of the fourth-grade 
public-school students in Alabama, the Southeast region, and the nation. 

• Part Two relates fourth-grade students’ reading performance to contextual 
information about the reading policies, instruction, and home support for 
reading in Alabama, the Southeast region, and the nation. 



11 See NAEP 1992 Reading Report Card for the Nation and the States . (Washington, DC: National Center for 
Education Statistics, 1993). 
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In this report, results are provided for groups of students defined by shared characteristics 
— race/ethnicity, type of community, parents’ education level, and gender. Definitions of 
the subpopulations referred to in this report are presented below. The results for Alabama 
are based on the representative sample of public-school students who participated in the 
1992 Trial State Assessment Program. The results for the nation and the region of the 
country are based on the nationally and regionally representative samples of public-school 
students who were assessed in January through March as part of the national NAEP 
program. Using the regional and national results from the 1992 national NAEP program 
is necessary because of the voluntary nature of the Trial State Assessment Program. Since 
not every state participated in the program, the aggregated data across states did not 
necessarily provide representative national or regional results. Specific details on the 
samples and analysis procedures used can be found in the Technical Report of the 1992 
NAEP Trial State Assessment Program in Reading} 2 



RACE/ETHNICITY 

Results are presented for students of different racial/ethnic groups based on the students’ 
self-identification of their race/ethnicity according to the following mutually exclusive 
categories: White, Black, Hispanic, Asian (including Pacific Islander), and American 
Indian (including Alaskan Native). Based on criteria described in the Procedural Appendix, 
there must be at least 62 students in a particular subpopulation in order for the results for 
that subpopulation to be considered reliable. Thus, results for racial/ethnic groups with 
fewer than 62 students are not reported. However, the data for all students, regardless of 
whether their racial/ethnic group was reported separately, were included in computing 
overall results for Alabama. 



TYPE OF COMMUNITY 

Results are provided for four mutually exclusive community types — advantaged urban, 
disadvantaged urban, extreme rural, and other — as defined below: 

Advantaged Urban: Students in this group live in metropolitan statistical areas 
and attend schools where, according to their schools, a high proportion of the 
students’ parents are in professional or managerial positions. 

Disadvantaged Urban: Students in this group live in metropolitan statistical 
areas and attend schools where, according to their schools, a high proportion 
of the students’ parents are on welfare or are not regularly employed. 



12 Technical Report of the NAEP 1992 Trial State Assessment Program in Reading. (Washington, DC: 
•National Center for Education Statistics, 1993). 
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Extreme Rural: Students in this group live outside metropolitan statistical 

areas, live in areas with a population below 10,000, and attend schools where, 
according to their schools, many of the students’ parents are farmers or farm 
workers. 

Other: Students in this category attend schools in areas other than those defined 
as advantaged urban, disadvantaged urban, or extreme rural. 

Indices were developed such that approximately 10 percent of the most extreme advantaged 
urban, disadvantaged urban, and rural schools sampled in the national assessment were 
classified into these three categories. The remaining 70 percent of the schools were 
classified into the “other” category. The reporting of results by each type of community 
was also subject to a minimum student sample size of 62. 

PARENTS’ EDUCATION LEVEL 

Students were asked to indicate the extent of schooling for each of their parents — did not 
finish high school, graduated from high school, some education after high school, or 
graduated from college. The response indicating the higher level of education was selected 
for reporting. Reporting of results by parents’ education level was also subject to a 
minimum student sample size of 62. Note that a substantial percentage of fourth-grade 
students did not know their parents’ education level. 



GENDER 

Results are reported separately for males and females. 



REGION 

The United States has been divided into four regions for purposes of this report: Northeast, 
Southeast, Central, and West. States included in each region are shown in Figure 1. All 
50 states and the District of Columbia are listed, with the participants in the Trial State 
Assessment highlighted in boldface type. Territories were not assigned to a region. 
Further, the part of Virginia that is included in the Washington, DC, metropolitan 
statistical area is included in the Northeast region; the remainder of the state is included in 
the Southeast region. Because most of the Virginia students are in the Southeast region, 
regional comparisons for Virginia are to the Southeast. 

The regional results are based on a separate sample from that used to report the state 
results. Regional results are based on national assessment samples, not on aggregated Trial 
State Assessment samples. 
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figure 1 | Regions of the Country 
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Guidelines for Analysis 

This report describes reading proficiency for fourth graders attending public schools and 
compares the results for various groups of students within that population — for example, 
those who have certain demographic characteristics or who responded to a specific 
background question in a particular way. The report examines the results for individual 
groups and individual background questions. It does not include an analysis of the 
relationships among combinations of these subpopulations or background questions. 

Because the proportions of students in these subpopulations and their average proficiencies 
are based on samples — rather than the entire population of fourth graders in public schools 
in a state or territory — the numbers reported are necessarily estimates. As such, they are 
subject to a measure of uncertainty, reflected in the standard error of the estimate. When 
the proportions or average proficiencies of certain groups are compared, it is essential to 
take the standard error into account, rather than rely solely on observed similarities or 
differences. Therefore, the comparisons discussed in this report are based on statistical tests 
that consider both the magnitude of the difference between the means or proportions and 
the standard errors of those statistics. 
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The statistical tests determine whether the evidence — based on the data from the groups 
in the sample — is strong enough to conclude that the means or proportions are really 
different for those groups in the population . If the evidence is strong (i.e., the difference is 
statistically significant ), the report describes the group means or proportions as being 
different (e.g., one group performed higher than or lower than another group) -- regardless 
of whether the sample means or sample proportions appear to be about the same or not. 
If the evidence is not sufficiently strong (i.e., the difference is not statistically significant), 
the means or proportions are described as being about the same — again, regardless of 
whether the sample means or sample proportions appear to be about the same or widely 
discrepant. The reader is cautioned to rely on the results of the statistical tests -- rather than 
on the apparent magnitude of the difference between sample means or proportions -- to 
determine whether those sample differences are likely to represent actual differences 
between the groups in the population. The statistical tests and Bonferroni procedure, 
which is used when more than two groups are being compared, are discussed in greater 
detail in the Procedural Appendix. 

In addition, some of the percentages reported in the text of the report are given quantitative 
descriptions (e.g., some, about half, almost all, etc.). The descriptive phrases used and the 
rules used to select them are described in the Procedural Appendix. 

Finally, in several places in this report, results (mean proficiencies and proportions) are 
reported in the text for combined groups of students. For example, in the text, the 
percentage of students in the combined group where teachers reported spending 60 minutes 
or 90 minutes or more on reading instruction on a typical day is given and compared to the 
group where teachers reported spending 45 minutes or less. However, the table that 
accompanies that text reports percentages and proficiencies separately for the three groups 
(45 minutes or less, 60 minutes, and 90 minutes or more). The combined group 
percentages reported in the text and used in all statistical tests are based on unrounded 
estimates (i.e., estimates calculated to several decimal places) of the percentages in each 
group. The percentages shown in the tables are rounded to integers. Thus, percentages 
may not always add up to 100 percent due to rounding. Also, the percentage for a 
combined group (reported in the text) may differ slightly from the sum of the separate 
percentages (presented in the tables) for each of the groups that were combined. Therefore, 
if statistical tests were to be conducted based on the rounded numbers in the tables, the 
results might not be consonant with the results of the statistical tests that are reported in 
the text (based on unrounded numbers.) 

Profile of Alabama 

FOURTH-GRADE SCHOOL AND STUDENT CHARACTERISTICS 

Table 1 provides a profile of the demographic characteristics of the fourth-grade 
public-school students in Alabama, the Southeast region, and the nation. This profile is 
based on data collected from the students and schools participating in the 1992 Trial State 
and National Assessments. As described earlier, the state data and the regional and 
national data are drawn from separate samples. 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



30 



21 



Alabama 



THE NATION S 
REPORT 
CARD 





Trial State Assessment 



TABLE 1 



Profile of Fourth-Grade 
Public-School Students in Alabama, 
the Southeast Region, and the 
Nation 



Alabama 



Southeast 



Nation 
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DEMOGRAPHIC SUBGROUPS 



Race/Ethnicity 

White 

Black 

Hispanic 

Asian 

American Indian 

Type of Community 

Advantaged urban 
Disadvantaged urban 
Extreme rural 
Other 

Parents' Education 

Graduated college 
Some education after high school 
Graduated high school 
Did not finish high school 
I don't know 

Gender 

Male 

Female 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, 
for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see 
Appendix A for details). The percentages for Race/ Ethnicity may not add to 100 percent because some 
students categorized themselves as “Other.” 



SCHOOLS AND STUDENTS ASSESSED 



Table 2 summarizes participation data for Alabama schools and students sampled for the 
1992 Trial State Assessment. 13 In Alabama, 105 public schools participated in the 
fourth-grade reading assessment. These numbers include participating substitute schools 
that were selected to replace some of the nonparticipating schools from the original sample. 
The weighted school participation rate was 97 percent, which means that the fourth-grade 
students in this sample of schools were directly representative of 97 percent of all the 
fourth-grade public-school students in Alabama. 
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13 For a detailed discussion of the NCES guidelines for sample participation, see School and Student 
Participation Rates for the Reading Assessment . (Washington, DC: National Center for Education Statistics, 
1993); or see Appendix B of the Technical Report of the NAEP 1992 Trial State Assessment Program in 
Reading. (Washington, DC: National Center for Education Stat^tics, 1993). 
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In each school, a random sample of students was selected to participate in the assessment. 
As estimated by the sample, 0 percent of the fourth-grade public-school population was 
classified as Limited English Proficient (LEP), while 10 percent in fourth grade had an 
Individualized Education Plan (IEP). An IEP is a plan, written for a student who has been 
determined to be eligible for special education, that typically sets forth goals and objectives 
for the student and describes a program of activities and/or related services necessary to 
achieve the goals and objectives. Handicapped or disabled students may be categorized 



Schools were permitted to exclude certain students from the assessment, provided that 
certain criteria were met. To be excluded, a student had to be categorized as Limited 
English Proficient or had to have an Individualized Education Plan and (in either case) be 
judged incapable of participating in the assessment. The intent was to assess all selected 
students; therefore, all selected students who were capable of participating in the assessment 
should have been assessed. However, schools were allowed to exclude those students who, 
in the judgment of school staff, could not meaningfully participate. The NAEP guidelines 
for exclusion are intended to assure uniformity of exclusion criteria from school to school. 
Note that some LEP and IEP students were deemed eligible to participate and not excluded 
from the assessment. The students in Alabama who were excluded from the assessment 
because they were categorized as LEP or had an IEP represented 5 percent of the 
population in grade four. 

In total, 2,571 fourth-grade Alabama public-school students were assessed. The weighted 
student participation rate was 96 percent. This means that the sample of students who 
took part in the assessment was directly representative of 96 percent of the eligible 
fourth-grade public-school student population in participating schools in Alabama (that is, 
all students from the population represented by the participating schools, minus those 
students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 93 percent. This 
means that the sample of students who participated in the assessment was directly 
representative of 93 percent of the eligible fourth-grade public-school population in 



In the analysis of student data and reporting of results, nonresponse weighting adjustments 
have been made at both the school and student level, with the aim of making the sample 



procedures, see the Technical Report of the NAEP 1992 Trial State Assessment Program in 
Reading. 



as IEP. 



Alabama. 



of participating students as representative as possible of the entire eligible fourth-grade 
public-school population. For details of the nonresponse weighting adjustment 
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TABLE 2 



Profile of the Fourth-Grade 
Population Assessed in Alabama 



PUBLIC SCHOOL PARTICIPATION 

Weighted school participation rate before substitution 

Weighted school participation rate after substitution 

Number of schools originally sampled 

Number of schools not eligible 

Number of schools in original sample participating 

Number of substitute schools provided 

Number of substitute schools participating 

Total number of participating schools 



PUBLIC-SCHOOL STUDENT PARTICIPATION 

Weighted student participation rate after makeups 

Number of students selected to participate in the assessment 

Number of students withdrawn from the assessment 

Percentage of students who were of Limited English Proficiency 

Percentage of students excluded from the assessment due to Limited 
English Proficiency 

Percentage of students who had an Individualized Education Plan 

Percentage of students excluded from the assessment due to Individualized 
Education Plan Status 

Number of students to be assessed 

Number of students assessed 

Overall weighted response rate 
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How Proficient in Reading are Fourth-Grade 
Students in Alabama Public Schools? 



Reading involves the interaction between a reader, a text, and a situation. 14 Thus, 
students’ reading comprehension is influenced by the type of material read and the specific 
purposes for reading. The 1992 Trial State Assessment Program considered students’ 
performance in situations that involved reading different kinds of materials for different 
purposes. The fourth-grade reading assessment measured two global purposes for reading 
- reading for literary experience and reading to gain information . 15 Reading for literary 
experience usually involves the reading of novels, short stories, plays, and essays. In these 
reading situations, the reader can determine how the author explores experiences through 
the text and can consider the interplay among events, emotions, and possibilities. Reading 
to gain information usually involves the reading of articles in magazines and newspapers, 
chapters in a textbook, entries in encyclopedias and catalogs, and entire books on particular 
topics. These reading situations call for different orientations to text from those in reading 
for literary experience because readers are specifically focused on acquiring information. 
Students’ performance on each of the two purposes for reading was summarized on 
separate NAEP reading scales (one for each purpose), which range from 0 to 500. In 
addition, an overall reading scale, reflecting combined performance in the two purposes for 
reading, was also developed. The overall reading scale also ranges from 0 to 500. 



14 Judith A. Langer, Arthur N. Applebee, Ina V.S. Mullis, and Mary A. Foertsch. Learning to Read in Our 
Nation's Schools. (Princeton, NJ: National Assessment of Educational Progress, Educational Testing 
Service, 1990). 

13 The eighth- and twelfth-grade national NAEP reading assessments also measured a third purpose for reading 
-- reading to perform a task. 
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This part of the report contains two chapters that describe the reading proficiency of 



fourth-grade public-school students in Alabama. Chapter 1 compares the overall reading 
performance of the students in Alabama to students in the Southeast region and the nation. 
It also presents the students’ average proficiency for the two purposes for reading. 

Chapter 2 summarizes the students’ overall reading performance, as well as performance 
for each of the two reading purposes, for subpopulations defined by race/ethnicity, type of 
community, parents’ education level, and gender. 
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CHAPTER 1 



Students’ Reading Performance 



Reading achievement is central to one of the goals adopted by the president and the 



governors following the historic Charlottesville conference — American students will leave 
grades four, eight, and twelve having demonstrated competency in challenging subject matter 
including English, mathematics, science, history, and geography ; and every school in America 
will ensure that all students learn to use their minds well, so they may be prepared for 
responsible citizenship, further learning, and productive employment in our modern 
economy Concern about attaining the goal and, more importantly, about the reading 
abilities of our nation’s students has increased recently because it appears that many 
students of all ages have difficulty reading thoughtfully. 17 

Reading for meaning involves a dynamic, complex interaction between and among the 
reader, the text, and the context. Readers, for example, bring to the process their prior 
knowledge about the topic, their reasons for reading it, their individual reading skills and 
strategies, and their understanding of differences in text structures. 

The texts used in the reading assessment are representative of common reading demands. 
Students in grade 4 are asked to respond to literary and informational texts which differ in 
structure, organization, and features. Literary texts include short stories, poems, and plays 
that engage the reader in a variety of ways, not the least of which is reading for fun. 
Informational texts include selections from textbooks, magazines, encyclopedias, and other 
written sources whose purpose is to increase the reader’s knowledge. 



16 AMERICA 2000: An Education Strategy (Washington, DC: U.S. Department of Education, 1991). 

17 Ina V.S. Mullis, John A. Dossey, Mary A. Foertsch, Lee R. Jones, and Claudia A. Gentile. Trends in 
Academic Progress. (Washington, DC: National Center for Education Statistics, 1992); Judith A. Langer, 
Arthur N. Applebee, Ina V.S. Mullis, and Mary A. Foertsch. Learning to Read in Our Nation's Schools. 
(Princeton, NJ: National Assessment of Educational Progress, Educational Testing Service, 1990); Richard 
C. Anderson, Elfrieda H. Hiebert, Judith A. Scott, Ian A. Wilkinson. Becoming a Nation of Readers. 
(Washington, DC: National Institute of Education, 1985). 
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The context of the reading situation includes the purposes for reading that the reader might 
use in building a meaning of the text. For example, in reading for literary experience, 
students may want to see how the author explores or uncovers experiences, or they may 
be looking for vicarious experience through the story’s characters. On the other hand, the 
student’s purpose in reading informational texts may be to learn about a topic (such as the 
Civil War or the oceans) or to search for specific information. 



The assessment asks students to build, extend, and examine text meaning from four stances 
or orientations: 

Students are asked to provide the overall or general meaning of the selection. This 
includes summaries, main points, or themes. 



Students are asked to extend the ideas in the text by making inferences and 
connections. This includes making connections between cause and effect, 
analyzing the motives of characters, and drawing conclusions. 

Students are asked to make explicit connections between the ideas in the text and 
their own background knowledge and experiences. This includes comparing story 
characters with themselves or people they know, for example, or indicating 
whether they found a passage useful or interesting. 

Critical Stance I Students are asked to consider how the author crafted a text. This includes 
identifying stylistic devices such as mood and tone. 



Personal 

Response 



Initial 

Understanding 



Developing an 
Interpretation 



These stances are not considered hierarchical or completely independent of each other, but 
are iterative. They provide a frame for generating questions and considering student 
performance at all levels. All students at all levels should be able to respond to reading 
selections from all of these orientations. What varies with students’ developmental and 
achievement levels is the amount of prompting or support needed for response, the 
complexity of the texts to which they can respond, and the sophistication of their answers. 

As shown in Figure 2, the overall average proficiency of fourth-grade public-school 
students from Alabama on the NAEP reading scale was 208. This proficiency was lower 
than that of students across the nation (216). 18 There also was a tremendous range in 
student performance as shown by the percentiles of the distribution of reading proficiency 
in Alabama presented in Table 3. The lowest performing 10 percent of the fourth graders 
from Alabama had proficiency levels below 160 while the top 10 percent had proficiency 
levels above 253. 



18 Differences reported as significant are statistically different at the 95 percent confidence level. This means 
that with 95 percent confidence there is a real difference in the average reading proficiency between the two 
populations of interest. “About the same” means that no statistically significant difference was found at the 
95 percent confidence level. 
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FIGURE 2 



Fourth-Grade Public-School Students’ 
Average Reading Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors are presented in parentheses. With about 
95 percent confidence, the average reading proficiency for each population of interest is within ± 2 standard 
errors of the estimated mean (95 percent confidence interval, denoted by HH). If the confidence intervals for 
the populations do not overlap, there is a statistically significant difference between the populations. If they do 
overlap, the difference may or may not be statistically significant. Statistical tests comparing the two estimates 
must be conducted that use the standard error of the difference (see Appendix A for details). 



TABLE 3 
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Percentiles of Reading Proficiency 
for Fourth-Grade Public-School 
Students 



5th 


10th 


25th 


50th 


75th 


90th 


95th 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 







Alabama 

Southeast 

Nation 




146 ( 2 . 4 ) 100 ( 2 . 1 ) 185 ( 2 . 5 ) 210 ( 1 . 7 ) 234 ( 2 . 0 ) 253 ( 1 . 5 ) 204 ( 2 . 2 ) 

140 ( 3 . 1 ) 103 ( 3 . 7 ) 188 ( 3 . 7 ) 214 ( 3 . 6 ) 236 ( 2 . 5 ) 256 ( 4 . 3 ) 268 ( 3 . 2 ) 

152 ( 2 . 0 ) 108 ( 1 . 7 ) 193 ( 1 . 1 ) 218 ( 1 . 4 ) 241 ( 1 . 4 ) 201 ( 1 . 9 ) 272 ( 1 . 6 ) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 
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LEVELS OF READING ACHIEVEMENT 

Average proficiency on the NAEP scale provides an overall depiction of students’ reading 
achievement; however, by itself, it does not describe what students know and are able to 
do, nor does it evaluate student performance against a standard. This report next presents 
a set of results based on applying the National Assessment Governing Board’s standards 
to student performance on the reading scale. 

When Congress established the National Assessment Governing Board (NAGB) in 1988 
to set policy for NAEP, it charged the board with “identifying appropriate achievement 
goals for each age and grade in each subject area to be tested under the National 
Assessment.” (Pub.L. 297-100, Section 3403 (a)(5)(B)(ii)). To carry out this responsibility, 
NAGB contracted with American College Testing (ACT) to undertake advisory and 
analytic functions that could assist the Board in forming its conclusions as to appropriate 
achievement levels to be used for evaluating the 1992 reading assessment results. 
Achievement levels are mappings of collective judgments about how students should 
perform onto the achievement scale. 19 Boundary points were developed for three 
achievement levels for each grade — Basic, Proficient, and Advanced. Performance at the 
Basic level denotes partial mastery of the knowledge and skills that are fundamental for 
proficient work at the fourth-grade level. The central level, called Proficient, represents 
solid academic performance at the fourth-grade level. Students reaching this level 
demonstrate competency over challenging subject matter and are well prepared for the next 
level of schooling. Achievement at the Advanced level signifies superior performance in the 
fourth grade. 

This report follows NAGB’s policy that achievement levels should be the primary and 
initial method of presenting the results of the 1992 Trial State Assessment. In this report, 
these achievement levels are applied to the 1992 data, showing the proportions of students 
that achieved the three achievement levels. 

Definitions of the three levels of reading achievement are given in Figure 3. Examples of 
items at the achievement levels are provided. The reading passage which accompanies these 
items can be found in Appendix B. It should be noted that constructed-response items 
occur at all levels of reading achievement. 
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19 Appendix C briefly describes the process of gathering expert judgments about Basic, Proficient, and 
Advanced performance - as defined by NAGB policy — on each reading item, combining the various 
judgments on the various items and mapping them onto the scale, and setting the scale score cutpoints for 
reporting purposes based on these levels. 
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FIGURE 3 



Levels of Reading Achievement at Grade 4 
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The following achievement-level descriptions focus on the interaction of the reader, the 
text, and the context. They provide some specific examples of reading behaviors that 
should be familiar to most readers of this document. The specific examples are not 
inclusive; their purpose is to help clarify and differentiate what readers performing at each 
achievement level should be able to do. While a number of other reading achievement 
indicators exist at every level, space and efficiency preclude an exhaustive listing. It should 
also be noted that the achievement levels are cumulative from Basic to Proficient to 
Advanced. One level builds on the previous levels such that knowledge at the Proficient 
level presumes mastery of the Basic level, and knowledge at the Advanced level presumes 
mastery at both the Basic and Proficient levels. 



BASIC 

TjXTT' 


Fourth-grade students performing at the Basic level should demonstrate an 
understanding of the overall meaning of what they read. When reading texts 




appropriate for fourth graders, they should be able to make relatively obvious 




connections between the text and their own experiences. 



Specifically, when reading literary text, they should be able to tell what the story is generally about ~ providing 
details to support their understanding — and be able to connect aspects of the stories to their own experiences. 

When reading informational text, Basic-level fourth graders should be able to tell what the selection is generally 
about or identify the purpose for reading it; provide details to support their understanding; and connect ideas 
from the text to their background knowledge and experiences. 









Fourth-grade students performing at the Proficient level should be able to 
demonstrate an overall understanding of the text, providing inferential as well 
as literal information. When reading text appropriate to fourth grade, they 
should be able to extend the ideas in the text by making inferences, drawing 
conclusions, and making connections to their own experiences. The connection 
between the text and what the student infers should be clear. 



Specifically, when reading literary text, Proficient-level fourth graders should be able to summarize the story, 
draw conclusions about the characters or plot, and recognize relationships such as cause and effect. 

When reading informational text, Proficient-level students should be able to summarize the information and 
identify the author’s intent or purpose. They should be able to draw reasonable conclusions from the text, 
recognize relationships such as cause and effect or similarities and differences, and identify the meaning of the 
selection’s key concepts. 





Fourth-grade students performing at the Advanced level should be able to 


^ADVANCED.; 


generalize about topics in the reading selection and demonstrate an awareness 


LEVEL 


of how authors compose and use literary devices. When reading text 




appropriate to fourth grade, they should be able to judge texts critically and, in 




general, give thorough answers that indicate careful thought. 
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Specifically, when reading literary text, Advanced-level students should be able to make generalizations about 
the point of the story and extend its meaning by integrating personal and other reading experiences with the 
ideas suggested by the text. They should be able to identify literary devices such as figurative language. 

When reading informational text, Advanced-level fourth graders should be able to explain the author’s intent by 
using supporting material from the text. They should be able to make critical judgments of the text (including 
its form and content) and explain their judgments clearly. 
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FIGURE 3 
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Levels of Reading Achievement at Grade 4 




Trial State Assessment 



The three items that follow were selected to exemplify each of the three achievement levels 
at grade 4. These items are all based on the story “Sybil Sounds the Alarm,” which is 
shown in its entirety in Appendix B. This is an historical narrative demonstrating the 
purpose “reading for literary experience.” For the multiple-choice items, the correct answer 
is marked with an asterisk. For the short constructed-response item, the scoring guide is 
provided. Also shown is the percent correct (conditional p-value) for the students 
performing within the interval of the indicated level. 







Percent Correct for Basic Interval 



Nation 



: 76(2-4) 



Sybil’s father thought that she 

A. was obedient but forgetful 
* B. was courageous and a good rider 

C. could lead the troops against the British 

D. could easily become angry 





PROFICIENT LEVEL 

. 


Percent Correct for Proficient Interval 


Nation 


illSSSi 



The information about the statue and stamp helps to show that 
+ A. people today recognize and respect Sybil’s bravery 

B. people were surprised that George Washington honored her 

C. the author included minor details 

D. heroes are honored more now than they were then 
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Percent Correct for Advanced Interval 
Nation 

How does the author show the excitement and danger of Sybil’s ride? 



^ 

Acceptable * 

Acceptable answers indicate at least one of the following: 

• that she showed how concerned Sybil’s parents were about letting Sybil ride; 

• told how Sybil felt during the ride and immediately afterward; 

• told how dangerous the ride was. 

For example: 

• By letting you know there might be soldiers waiting to stop her; 

• By using special words to make it feel dangerous; 

• By using details like her mouth was dry with fear; 

• The way she described how she acted and how she looked; 

• There’s a battle going on near her, and she had to ride off the trail because red 
coats would stop her at any cost. 

Unacceptable 
For example: 

• By saying she was riding a horse. 
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DESCRIBING FOURTH-GRADE STUDENTS’ PERFORMANCE AT THE 
ACHIEVEMENT LEVELS 

Because the process of setting the levels of reading achievement centered on the descriptions 
of what students should be able to do, it is important to explore whether students actually 
met the expectations for performance at the Basic, Proficient, and Advanced levels. To 
help in this process, NCES arranged for ETS to apply a modified anchoring procedure to 
the 1992 reading achievement levels. A committee of reading education experts was 
assembled to review the questions and assessment results. Using their knowledge of reading 
and student performance on the individual questions, the committee members were asked 
to summarize student performance at each achievement level (see Appendix D for more 
details on the anchoring procedure). 

Placing the descriptions of how students performed at each of the levels in the context of 
the expectations for achievement at each of the levels and cross-checking with the actual 
question-by-question results yields some interesting findings. In general, the sets of reading 
skills expected were those observed. However, in some instances, particularly for extended 
response questions, even Advanced-level students had difficulty providing in-depth answers. 
In some other instances, because the assessment was developed prior to the achievement 
level descriptions, particular reading skills were not measured. 

In the description of students' performance beginning on the following page, each of the 
three achievement levels is discussed in turn - Basic, Proficient, then Advanced. For each 
of the three levels, the operational definition is presented (reproduced from Figure 3) 
followed in turn by a description of assessment performance at that achievement level 
which draws on the anchoring results. These descriptions are intended to be cumulative 
from Basic-level performance through Advanced. Therefore, demonstrated ability at the 
Proficient level presumes Basic-level performance, and Advanced performance presumes 
Proficient, as well as Basic abilities. 
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Fourth-grade students performing at the Basic level should demonstrate an 
understanding of the overall meaning of what they read. When reading texts 
appropriate for fourth graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 



Specifically, when reading literary text, they should be able to tell what the story is generally about - providing 
details to support their understanding ~ and be able to connect aspects of the stories to their own experiences. 

When reading informational text, Basic-level fourth graders should be able to tell what the selection is generally 
about or identify the purpose for reading it; provide details to support their understanding; and connect ideas 
from the text to their background knowledge and experiences. 

Fourth-grade students at the Basic level in the 1992 NAEP reading assessment were able 
to read uncomplicated narratives with understanding. The literary texts at this level 
included fables and realistic fiction about familiar topics. In addition, they were able to gain 
information from high-interest informative texts that were structured as narratives and dealt 
with relatively familiar topics, such as animals and sports. 

When reading literary text , Basic-level students demonstrated a general understanding of 
the stories by identifying an obvious theme or message. They answered questions about 
specific parts of the stories and provided details to support their understanding of 
characters’ feelings or actions. Fourth graders at the Basic level had considerable success 
in answering questions about the traits and functions of characters. For example, in the 
nation, 76 percent of the students within the Basic-level interval correctly answered the item 
about Sybil’s father. In addition, connections to their own experiences tended to involve 
aspects of characters. They could relate to the feelings of familiar characters. 

When reading informational text , Basic -level fourth graders were able to search for and 
locate explicit information in order to provide a summarization of part of the text. They 
were able to identify situations described in text and build simple inferences based on 
specific details. Although fourth-grade students were not asked directly to identify the 
purpose for reading an informational text, they were able to construct their own simple 
questions related to material they had read. They were only partially successful at making 
connections to background knowledge or experiences when reading to gain information. 
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Fourth-grade students performing at the Proficient level should be able to 




PROFICIENT 


demonstrate an overall understanding of the text, providing inferential as well 


LEVEL 


as literal information. When reading text appropriate to fourth grade, they 


(243) 


should be able to extend the ideas in the text by making inferences , drawing 
conclusions, and making connections to their own experiences. The connection 




between the text and what the student infers should be clear. 



Specifically, when reading literary text, Proficient-level fourth graders should be able to summarize the story, 
draw conclusions about the characters or plot, and recognize relationships such as cause and effect. 

When reading informational text, Proficient-level students should be able to summarize the information and 
identify the author’s intent or purpose. They should be able to draw reasonable conclusions from the text, 
recognize relationships such as cause and effect or similarities and differences, and identify the meaning of the 
selection’s key concepts. 

Fourth-grade students at the Proficient level were able to understand and extend the 
meaning of more difficult, unfamiliar literary pieces — those in culturally different or 
historical settings. They were able also to gain information, interpret meaning, and connect 
to background experiences when reading informative text that contained narrative elements 
and direct quotes. 

When reading literary text , Proficient-level fourth graders demonstrated an overall 
understanding by constructing responses to a story as a whole, as well as considering 
subtleties in aspects of stories. However, they were unable to provide an adequate story 
summary when asked to describe the major events in an historical fiction. Building on the 
skills demonstrated at the Basic level related to identifying and interpreting characters’ 
actions and feelings, Proficient-level students were able to draw conclusions about 
characters’ actions and recognize multiple character perspectives. In addition, they could 
recognize obvious cause-and-effect relationships that were related to story events. 
Fourth-grade students at this level demonstrated an ability to connect information in the 
story to the author’s purpose. For the example item, in the nation, 90 percent of the 
students within the Proficient-level interval were able to identify the significance of the 
information about the statue and the stamp in recognizing Sybil’s bravery. 

When reading informational text, Proficient-level fourth graders were able to identify major 
ideas and make straightforward inferences that were connected clearly to the text. They 
were able to recognize an author’s basic organizational pattern and general purpose. They 
could draw conclusions about key concepts and generalize across parts of the text. 
However, when asked to describe cause-and-effect relationships requiring a thoughtful 
consideration of implicit information, they were only partially successful. Their responses 
provided evidence that they could search for, locate, prioritize, and apply relevant 
information. Also, they could relate information from the selection to their own 
background experience and to inferences that were provided for them. 
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Fourth-grade students performing at the Advanced level should be able to 
generalize about topics in the reading selection and demonstrate an awareness 
of how authors compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge texts critically and, in 
general, give thorough answers that indicate careful thought. 



Specifically, when reading literary text, Advanced-level students should be able to make generalizations about 
the point of the story and extend its meaning by integrating personal and other reading experiences with the 
ideas suggested by the text. They should be able to identify literary devices such as figurative language. 

When reading informational text, Advanced-level fourth graders should be able to explain the author’s intent by 
using supporting material from the text. They should be able to make critical judgments of the text (including 
its form and content) and explain their judgments clearly. 



Fourth-grade students at the Advanced level experienced success with literary and 
informative texts about less familiar topics. They not only demonstrated understanding 
of what they read, but also were able to extend, elaborate on, and examine the meaning 
of literary and informative text. 

When reading literary text , Advanced-level fourth graders were able to construct responses 
to a story and generalize about topics in a reading selection by selecting relevant 
information and building their own interpretations that remained consistent with the text. 
In addition, they were able to provide brief summarizations across the whole story. They 
demonstrated only partial ability, however, in integrating their personal experiences and 
other reading with ideas suggested by the text. Fourth graders at the Advanced level were 
able to understand some literary devices, such as figurative language, and could interpret 
authors’ intentions. For example, in the nation, 84 percent of the fourth-grade students 
within the Advanced-level interval were able to provide acceptable responses to the 
question about the author’s techniques in the story about Sybil. 

When reading informational text , Advanced-level students were able to provide an 
explanation of the author’s techniques for presenting information, although fourth graders 
were not explicitly asked to support their explanations. They did, however, use 
information presented in the text to answer other questions. For example, they were able 
to make critical judgments about the form and content of the text by indicating the relative 
importance of ideas and were able to gain a more thorough understanding of a particular 
topic. Some Advanced-level fourth graders could develop their own ideas based on the 
information presented in the passages and form more complex questions about a selection. 
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Figure 4 provides the percentage of students at or above each achievement level, as well 
as the percentage of students below the Basic level. In Alabama, 48 percent of the fourth 
graders in public schools were at or above the Basic level, 17 percent were at or above the 
Proficient level, and 2 percent were at or above the Advanced level. Nationwide, 

57 percent of the fourth graders were at or above the Basic level, 24 percent were at or 
above the Proficient level, and 4 percent were at or above the Advanced level. A smaller 
percentage of students in Alabama than across the nation were at or above the Proficient 
level. 



FIGURE 4 



Levels of Fourth-Grade Public-School 
Students’ Reading Achievement 
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The standard errors are presented in parentheses. With about 95 percent confidence, the 
average reading proficiency for each population of interest is within ± 2 standard errors of 
the estimated mean (95 percent confidence interval, denoted by HH). If the confidence 
intervals for the populations do not overlap, there is a statistically significant difference 
between the populations. If they do overlap, the difference may or may not be statistically 
significant. Statistical tests comparing the two estimates must be conducted that use the 
standard error of the difference (see Appendix A for details). 
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Clearly, many students in Alabama fail to meet or exceed the achievement levels that 
prescribe what students should know and should be able to do. Educators and 
policymakers will need to look to many sources of information and opinion for 
explanations of these levels of performance. Among the possible explanations, several 
factors should not be overlooked. First, students may not be learning enough in school to 
reach the achievement levels. In 1983, the National Commission on Excellence in 
Education warned that “the educational foundations of our society are being eroded by a 
rising tide of mediocrity that threatens our very future.” 20 In 1990, the President and the 
Governors committed the Nation to six goals for education, the third of which called for 
American students to “leave grades four, eight and twelve having demonstrated competency 
in challenging subject matter.” Many political leaders of this nation have expressed 
dissatisfaction with the performance of American students. These NAEP findings confirm 
that a great many American students are not yet performing at high levels. 

Second, some students may not be reaching the higher achievement levels because schools 
may not be teaching the elements of reading that are included on the NAEP assessment, 
and because the assessment may not be covering some elements of reading included in the 
school curriculum. No assessment or test can cover all the different areas of reading that 
are taught in school. The content coverage of the NAEP reading assessment was set by a 
consensus approach. Teachers, curriculum specialists, subject matter specialists, local 
school administrators, parents, and members of the general public actively participated in 
deciding what are the most important elements of reading to be included in the assessment 
and for students to learn. 21 

Third, the Basic, Proficient, and Advanced achievement levels reflect high performance 
standards for the 1992 NAEP reading scale. The establishment of achievement levels 
depends on securing a set of informed judgments of expectations for student educational 
performance and on summarizing the individual ratings into collective judgments. These 
expectations reflect the Board’s policy definitions, which require that students at the central, 
Proficient level demonstrate “competency over challenging subject matter.” The resulting 
standards are rigorous. 

As measures of performance, both average proficiency scores and percentages of students 
who score at or above the critical achievement levels on the NAEP scale provide a valuable 
overall depiction of students’ reading achievement. In order to present a closer look at how 
well students know particular areas of reading, the next section presents student 
performance according to two purposes for reading. 



20 National Commission on Excellence in Education, A Nation at Risk. (Washington, DC: U.S. Department 
of Education, 1983). In 1988, then-Secretary Bennett reported that the “precipitous downward slide of 
previous decades has been arrested, and we have begun the long climb back to reasonable standards, (p. 1 
in American Education: Making it Work. (Washington, DC: U.S. Department of Education, 1988).) 

21 NAEP Reading Consensus Project. Reading Framework for the 1992 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, 1992). 
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PERFORMANCE ACCORDING TO PURPOSE FOR READING 



As previously indicated, the cognitive questions in the Trial State Assessment covered two 
purposes for reading at grade 4 — reading for literary experience and reading to gain 
information. Figure 5 (average proficiency) and Table 4 (percentiles) provide results for 
Alabama, the Southeast region, and the nation according to each reading purpose. 
Students in Alabama performed lower than students across the nation in reading for literary 
experience and to gain information. 



FIGURE 5 



Fourth-Grade Public-School Students’ 
Average Reading Proficiency According to 
Purpose for Reading 
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The NAEP reading scale ranges from 0 to 500. The standard errors are presented in 
parentheses. With about 95 percent confidence, the average reading proficiency for each 
population of interest is within ± 2 standard errors of the estimated mean (95 percent 
confidence interval, denoted by M-H). If the confidence intervals for the populations do not 
overlap, there is a statistically significant difference between the populations. If they do 
overlap, the difference may or may not be statistically significant. Statistical tests comparing 
the two estimates must be conducted that use the standard error of the difference (see 
Appendix A for details). 
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Trial State Assessment 
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TABLE 4 



Percentiles of Reading Proficiency 
for Fourth-Grade Public-School 
Students by Purpose for Reading 
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220 ( 1.3) 



207 ( 2.2) 
211 ( 3.4) 
215 ( 1.1) 



238 ( 2.2) 258 ( 1.1) 269 ( 2.8) 

239 (2.7) 259 ( 2.3) 271 ( 4.1) 

244 ( 1.3) 265(1.4) 277 ( 2.6) 

232 ( 1.9) 253 ( 1.7) 265 ( 3.5) 

235 ( 3.0) 256 ( 4.0) 270 ( 5.1) 

239 { 1,3) 260 { 1.8) , 272 ( 1.7) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 
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CHAPTER 2 

Reading Performance by Subpopulations 



Assessment results repeatedly show differences in achievement for subpopulations of 
students. 22 The 1992 Trial State Assessment provides additional information about the 
achievement of important subpopulations by reporting on the performance of various 
subgroups of the student population defined by race/ethnicity, type of community, parents 
education level, and gender. 



RACE/ETHNICITY 

The Trial State Assessment results for different racial/ethnic groups can be compared when 
the number of students in a racial/ethnic group is sufficient in size to be reliably reported 
(at least 62 students). Figure 6 (average proficiency) and Table 5 (percentiles) present 
reading performance results for White, Black, and Hispanic students from Alabama. 



22 lna V.S. Mullis, John A. Dossey, Mary A. Foertsch, Lee R. Jones, and Claudia A. Gentile. Trends in 
Academic Progress. (Washington, DC: National Center for Education Statistics, 1992). 
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As shown in Figure 6, White students in Alabama demonstrated higher average reading 
proficiency than did Black or Hispanic students. 



FIGURE 6 



Fourth-Grade Public-School Students’ 
Average Reading Proficiency by 
Race/Ethnicity 




Trial State Assessment 




The NAEP reading scale ranges from 0 to 500. The standard errors are presented in parentheses. With about 
95 percent confidence, the average reading proficiency for each population of interest is within ± 2 standard 
errors of the estimated mean (95 percent confidence interval, denoted by HH). If the confidence intervals for 
the populations do not overlap, there is a statistically significant difference between the populations. If they do 
overlap, the difference may or may not be statistically significant. Statistical tests comparing the two estimates 
must be conducted that use the standard error of the difference (see Appendix A for details). ! Interpret with 
caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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TABLE 5 



Percentiles of Reading Proficiency 
for Fourth-Grade Public-School 
Students by Race/Ethnicity 



5th 

Percentile 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


95th 

Percentile 





161 (4.3) 
164 { 5,8} 
166(2.5) 

SiSlilSI 

133(3.5) 
137 ( 9.2) 
134 ( 2.5) 

127 (14.7) 
130(5.9) 
137 ( 5.3) 



■ S . : V’ :: SL vSsis 



180 ( 2.7) 

150 ( 7.3) 
147 ( 3.6) 

142 ( 9.6) 
141 (26.0); 

151 ( 4.0) 



.198(1.9) 
200 ( 4.9) 
203 ( 1.4) 

/ 

' \ * , .. 

166 ( 2.9) 
173 ( 3.5) 
169 ( 3.5) 



167 ( 4.8) 
167 ( 8.7) 

®ii|(0ig 



221(2.2) 242 ( 1.4) 

226( 1.9) 247(1.4) 

190 ( 3.3) 212 ( 2.0) 

195(4.1) 218(3.2) 

194(2,1) 216(3.9) 

.... 

196 (13.7) 216 ( 4.4) 

197 ( 5.1) 224 ( 3.6) 

201 ( 4.3). 226 ( 3;5)i 



I Hi 

260 ( 2.5) 270(1.6)1 

263 ( 3.9) 273 ( 4.0) 

266 ( 1.7) 276 ( 3.2) 

■■■■■Mi 

230 ( 1(8) 230 ( 2.5) 

238 ( 412) 253 ( 2.5) 



233 (11.3) 246 (14.8) 
243 ( 5.5) 252 ( 6.8) 

247 ( 2.9) . .258 ( 5.1) 

’ 



The NAEP reading scale ranges fromO to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 



Figure 7 provides the percentage of students by race/ethnicity group at or above each of 
the three achievement levels and also the percentage below the Basic level. In Alabama, 
about one quarter of the White students (24 percent), relatively few of the Black students 
(4 percent), and relatively few of the Hispanic students (6 percent) were at or above the 
Proficient level. Across the nation, about one quarter of the White students (30 percent), 
relatively few of the Black students (7 percent), and some of the Hispanic students 
(12 percent) were at or above the Proficient level. 



BEST COPY AVAILABLE 



53 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



45 



Alabama 



FIGURE 7 



Levels of Fourth-Grade Public-School 
Students’ Reading Achievement by 
Race/Ethnicity 
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The standard errors are presented in parentheses. With about 95 percent confidence, the 
average reading proficiency for each population of interest is within ± 2 standard errors of 
the estimated mean (95 percent confidence interval, denoted by HH). If the confidence 
intervals for the populations do not overlap, there is a statistically significant difference 
between the populations. If they do overlap, the difference may or may not be statistically 
significant. Statistical tests comparing the two estimates must be conducted that use the 
standard error of the difference (see Appendix A for details). ! Interpret with caution — the 
nature of the sample does not allow accurate determination of the variability of this statistic. 
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TYPE OF COMMUNITY 

Figure 8 (average proficiency) and Table 6 (percentiles) present the reading proficiency 
results for fourth-grade students attending public schools in advantaged urban areas, 
disadvantaged urban areas, extreme rural areas, and areas classified as “other”. (These are 
the “type of community” groups in Alabama with student samples large enough to be 
reliably reported.) The results indicate that the average reading performance of Alabama 
students attending schools in advantaged urban areas was higher than that of students 
attending schools in disadvantaged urban areas, extreme rural areas, or areas classified as 
“other”. 



FIGURE 8 



Fourth-Grade Public-School Students’ 
Average Reading Proficiency by Type of 
Community 
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The NAEP reading scale ranges from 0 to 500. The standard errors are presented in parentheses. With about 
95 percent confidence, the average reading proficiency for each population of interest is within ± 2 standard 
errors of the estimated mean (95 percent confidence interval, denoted by I I I). If the confidence intervals for 
the populations do not overlap, there is a statistically significant difference between the populations. If they do 
overlap, the difference may or may not be statistically significant. Statistical tests comparing the two estimates 
must be conducted that use the standard error of the difference (see Appendix A for details). ! Interpret with 
caution - the nature of the sample does not allow accurate determination of the variability of this statistic. 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 



Figure 9 presents reading performance by achievement levels. Less than half of the students 
attending schools in advantaged urban areas (32 percent), relatively few of the students in 
disadvantaged urban areas (5 percent), some of the students in extreme rural areas 
(18 percent), and some of the students in areas classified as “other” (18 percent) in 
Alabama were at or above the Proficient level. Across the nation, about half of the 
students in advantaged urban areas (47 percent), relatively few of the students in 
disadvantaged urban areas (5 percent), about one quarter of the students in extreme rural 
areas (24 percent), and about one quarter of the students in areas classified as “other” 

(24 percent) were at or above the Proficient level. 
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FIGURE 9 



Levels of Fourth-Grade Public-School 
Students’ Reading Achievement by Type of 
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PERCENT 

The standard errors are presented in parentheses. With about 95 percent confidence, the 
average reading proficiency for each population of interest is within ± 2 standard errors of 
the estimated mean (95 percent confidence interval, denoted by HH). If the confidence 
intervals for the populations do not overlap, there is a statistically significant difference 
between the populations. If they do overlap, the difference may or may not be statistically 
significant. Statistical tests comparing the two estimates must be conducted that use the 
standard error of the difference (see Appendix A for details). ! Interpret with caution — the 
nature of the sample does not allow accurate determination of the variability of this statistic. 



PARENTS’ EDUCATION LEVEL 

Previous NAEP findings have shown that students whose parents are better educated tend 
to have higher reading proficiency. Figure 10 (average proficiency), Table 7 (percentiles), 
and Figure 1 1 (achievement levels) show the reading performance results for fourth-grade 
public-school students who reported that at least one parent graduated from college, at least 
one parent had some education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know their parents’ 
education level. Note that a substantial percentage of fourth-grade students did not know 
their parents’ education level. 
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As shown in Figure 10, students in Alabama who reported that at least one parent 
graduated from college demonstrated about the same average reading proficiency as did 
students who reported that at least one parent had some education after high school or at 
least one parent graduated from high school, but higher proficiency than did students who 
reported that neither parent graduated from high school or they did not know their parents’ 
education level. 



FIGURE 10 



Fourth-Grade Public-School Students’ 
Average Reading Proficiency by Parents’ 
Level of Education 
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The NAEP reading scale ranges from 0 to 500. The standard errors are presented in parentheses. With about 
95 percent confidence, the average reading proficiency for each population of interest is within ± 2 standard 
errors of the estimated mean (95 percent confidence interval, denoted by HM). If the confidence intervals for 
the populations do not overlap, there is a statistically significant difference between the populations. If they do 
overlap, the difference may or may not be statistically significant. Statistical tests comparing the two estimates 
must be conducted that use the standard error of the difference (see Appendix A for details). 
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TABLE 7 



Percentiles of Reading Proficiency 
for Fourth-Grade Public-School 
Students by Parents’ Level of 
Education 



5th 


10th 


25th 


50th 


75th 


80th 


85th 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



College graduate 

Alabama 

Southeast 

Nation 

Some after HS 

Alabama 

Southeast 

Nation 

HS graduate 

Alabama 

Southeast 

Nation 

HS non-graduate 

Alabama 

Southeast 

Nation 

t don't know 

Alabama 

Southeast 

Nation 



155 ( 5.4) 168 ( 3.6) 191 ( 2.5) 218 ( 2.4) 242 ( 1.8) 260 ( 2.5) 271 ( 2.8) 

153 ( 7,4) 172 ( 5.3) 195 (5.1) 222 (2.0) 246 (4.5) 266.(4.7) 278 ( 3.5) 

160( 2.7) 175(4.0) 200(2.4) 227(2.5) 250 ( 1.5) 269 ( 1.3) 280 ( 2.8) 

153 ( 7.0) 171 l 5.2) 197 ( 6.7) 221 ( 2.0) 243 ( 2.5) 261 ( 3.9) 270 ( 6.2) 

150 (10.0) 167 ( 8.3) 195 ( 7$); 217 ( 4.0) 243 ( 8.1) 261 (10.8) ^7S»<(1^)V 

182 ( 7.9) 177 ( 8.0) 202 ( 3.8) 225 ( 4.4) 246 ( 3.2) 266 ( 7.3) 277 ( 4.9) 

147 ( 2.6) 163 ( 3.4) 187(3.1) 210(3.2) 231(2.8) 251 ( 3.1) 262 (5.4) 

151 (12.0) 160 ( 5.9) 183 ( 8.3) . ( 2.9) 

151 ( 3.4) 165 ( 1.0) 190 C ' 265( 

139(7.8) 154(6.0) 175 ( 5.4) 200(2.5) 222(1.7) 240 ( 3.7) 251 ( 3.1) 

146 ( 5.7L%4§5'{10.1)/ 175.1(10^3) 199 ( 4.2) . ■ 221 (6.8). 23Zf( 7-0) ,251 ( 8.5) 

142 ( 5.3) 154 ( 6.4) 175 { 8.2) 199 ( 3.0) 222 ( 6.4) :243 ( 4:8 ) % :|255l( 9.8) 

138(3.1) 151(5.3) 175(4.8) 202(2.2) 225 ( 2.7) 244(1.6) 255(2.1) 

145 ( 8.4) . 160 ( 4.7) 185 ( 4.2) 209 ( 5.5) 230 ( 25) 246 ( 4.6) 257 ( 8.6) 

148(1.6) 163(1.9) 188(1.9) 213(1.5) 234(1.9) 253 ( 2.2) 264 ( 3.1) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 



Further, from Figure 11, reading achievement in Alabama was at or above the Proficient 
level for 24 percent of the students who reported that at least one parent graduated from 
college, 25 percent of the students who reported that at least one parent had some 
education after high school, 14 percent of the students who reported that at least one 
parent graduated from high school, 8 percent of the students who reported that neither 
parent graduated from high school, and 11 percent of the students who reported that they 
did not know their parents’ education level. Across the nation, these figures were 
33 percent of the students who reported that at least one parent graduated from college, 

28 percent of the students who reported that at least one parent had some education after 
high school, 18 percent of the students who reported that at least one parent graduated 
from high school, 10 percent of the students who reported that neither parent graduated 
from high school, and 17 percent of the students who reported that they did not know their 
parents’ education level. 
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FIGURE 11 



Levels of Fourth-Grade Public-School 
Students’ Reading Achievement by Parents’ 
Level of Education 
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PERCENT 

The standard errors are presented in parentheses. With about 95 percent confidence, the 
average reading proficiency for each population of interest is within ± 2 standard errors of 
the estimated mean (95 percent confidence interval, denoted by HH). If the confidence 
intervals for the populations do not overlap, there is a statistically significant difference 
between the populations. If they do overlap, the difference may or may not be statistically 
significant. Statistical tests comparing the two estimates must be conducted that use the 
standard error of the difference (see Appendix A for details). 
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GENDER 



In general, NAEP reading assessment results for males and females support numerous 
studies that have revealed gender differences favoring females in reading. 23 The 1992 Trial 
State Assessment results for Alabama support those findings. 



As shown in Figure 12, in Alabama, fourth-grade boys attending public schools had a lower 
average reading proficiency than did fourth-grade girls. Compared to the national results, 
girls in Alabama performed lower than girls across the country; boys in Alabama performed 
lower than boys across the country. Table 8 provides the percentiles for fourth-grade 
reading performance results by gender. 



FIGURE 12 



Fourth-Grade Public-School Students’ 
Average Reading Proficiency by Gender 




Trial State Assessment 




The NAEP reading scale ranges from 0 to 500. The standard errors are presented in parentheses. With about 
95 percent confidence, the average reading proficiency for each population of interest is within ± 2 standard 
errors of the estimated mean (95 percent confidence interval, denoted by HH). If the confidence intervals for 
the populations do not overlap, there is a statistically significant difference between the populations. If they do 
overlap, the difference may or may not be statistically significant. Statistical tests comparing the two estimates 
must be conducted that use the standard error of the difference (see Appendix A for details). 



23 Gita Z. Wilder and Kristin Powell, Sex Differences in Test Performance: A Survey of the Literature. (New 
York: College Entrance Examination Board, 1989). 
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TABLE 8 



Percentiles of Reading Proficiency 
for Fourth-Grade Public-School 
Students by Gender 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 



As shown in Figure 13, there was a significant difference between the percentages of males 
and females in Alabama who attained the Proficient level (20 percent for females and 
14 percent for males). The percentage of females in Alabama who attained the Proficient 
level was lower than the percentage of females in the nation who attained the Proficient 
level (20 percent for Alabama and 26 percent for the nation). Similarly, the percentage 
of males in Alabama who attained the Proficient level was lower than the percentage of 
males in the nation who attained the Proficient level (14 percent for Alabama and 
21 percent for the nation). 



PERFORMANCE ACCORDING TO PURPOSE FOR READING 

Table 9 provides a summary of performance according to each of the two purposes for 
reading by race/ethnicity, type of community, parents’ education level, and gender. 
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Fourth-Grade Public-School 
Students’ Average Reading 
Proficiency for “Purpose for 
Reading” by Subpopulafion 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution - the nature of 
the sample does not allow accurate determination of the variability of this statistic. 
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PART TWO Trial State AsMumwrt 

Finding a Context for Understanding Students’ 
Reading Proficiency 




Information on the reading performance of students in Alabama can be better understood 
and used for improving instruction and setting policy when supplemented with contextual 
information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 1992 Trial 
State Assessment, their reading teachers, and the principals or other administrators in their 
schools were asked to complete questionnaires on policies, instruction, and programs. The 
student, teacher, and school data help to describe some of the current practices and 
emphases in reading education, iUuminate some of the factors that appear to be related to 
fourth-grade public-school students’ reading proficiency, and provide an educational 
context for understanding information on student achievement. 

It is important to note that the NAEP data cannot establish cause-and-effect links between 
various contextual factors and students’ reading proficiency. However, the results do 
provide information about important relationships between the contextual factors and 
proficiency. Through the questionnaires administered to students, teachers, and principals, 
NAEP is able to provide a broad picture of educational practices prevalent in American 
schools and classrooms. 

Part Two consists of four chapters. Chapter 3 discusses policies and practices related to 
reading. Chapter 4 focuses on instructional practices — how instruction is delivered. 
Chapter 5 provides information about teachers, and Chapter 6 examines students’ home 
support for literacy. 
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CHAPTER 3 



Policies and Practices Related to Reading 



This chapter focuses on curricular and instructional content issues in Alabama public 
schools and their relationship to students’ reading proficiency. Table 10 provides a profile 
of the reading policies in the public schools with fourth grades in Alabama. Some of the 
selected results obtained from teacher and school questionnaires reveal: 

• According to the schools in Alabama, 79 percent of the fourth-grade 
students were in schools where reading was identified as receiving special 
emphasis. This compares with 86 percent across the country. 

• According to their reading teachers, 32 percent of the students in Alabama 
were typically taught reading in a class that was grouped by reading ability. 
Ability grouping was about as prevalent across the nation (34 percent). 

• According to the schools in Alabama, 61 percent of the students were in 
schools in which the fourth-grade students stay with the same teacher for 
all academic subjects, 15 percent were in schools in which students have 
different teachers in most or all academic subjects, and 24 percent were in 
schools in which students remain with one teacher for most subjects but 
may have a different teacher for one or two subjects. Across the country 
these figures were 48 percent, 10 percent, and 42 percent, respectively. 

• According to the teachers in Alabama, 54 percent of the students had 
teachers who had a reading curriculum specialist available to help or advise. 
Nationally, 64 percent of the students had teachers who had a reading 
curriculum specialist available to help or advise. 

• According to the schools in Alabama, 80 percent of the fourth graders were 
in schools in which parents were used as aides in the classroom. This 
compares with 89 percent across the country. 
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TABLE 10 



Reading Policies and Practices in 
Alabama Fourth-Grade Public 
Schools 



Alabama 



Southeast 



Nation 



Percentage of students in public schools that identified 


' n 

Percentage 

79 ( 3.8) 


S i 

Percentage 


reading as receiving special emphasis in school-wide 


: ' > 


goals and objectives, instruction, in-service training, etc. 


68(4.9) 


Percentage of students in public schools who are 


■ 




assigned to a reading class by their reading ability 
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different teacher for one or two subjects 
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a reading curriculum specialist is available to 
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help or advise 
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Percentage of students in public schools that use 
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parents as aides in classrooms 




ISSslSi 



Percentage 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, 
for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see 
Appendix A for details). 



TIME FOR INSTRUCTIONAL ACTIVITIES 

Studies of school effectiveness indicate that schools that are successful in teaching reading 
maximize the amount of time available for student learning. 24 Thus, to begin to place 
students’ reading proficiency in context, it is useful to examine the extent to which 
fourth-grade students’ reading teachers in Alabama are spending their time on instructional 
activities. Students’ teachers were asked to report on the amount of time they spent with 
each class for reading instruction on a typical day. Table 1 1 and Table All (Page 136) in 
the Data Appendix 25 show that: 



24 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report 
of the Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 

25 For every table in the body of the report that includes estimates of average proficiency, the Data Appendix 
provides a corresponding table presenting the results for the four subpopulations -- race/ethnicity, type of 
community, parents’ education level, and gender. 
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• In Alabama, 88 percent of the fourth-grade students had reading teachers 
who spent at least 60 minutes providing reading instruction each day. By 
comparison, 12 percent of the students had reading teachers who spent 
45 minutes or less providing reading instruction each day. 

• Across the nation, 71 percent of the fourth-grade students had reading 
teachers who spent at least 60 minutes providing reading instruction each 
day. Additionally, 29 percent of the students had reading teachers who 
spent 45 minutes or less providing reading instruction each day. 

• In Alabama, students whose reading teachers provided at least 60 minutes 
of reading instruction had about the same reading proficiency as did 
students whose teachers provided 45 minutes or less of reading instruction 
each day. 

• In Alabama, the results by type of community show that 93 percent of the 
students attending schools in advantaged urban areas, 92 percent of the 
students in disadvantaged urban areas, 78 percent of the students in 
extreme rural areas, and 90 percent of the students in areas classified as 
“other” had teachers who spent at least 60 minutes providing reading 
instruction each day. 




Trial State Assessment 



TABLE 11 



Teachers’ Reports on Time Spent 
Teaching Reading 
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Nation 
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About how much time do you spend on reading 
instruction on a typical day? 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 
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INSTRUCTIONAL EMPHASIS 



There is no single best method for teaching and learning reading that is proven to be 
successful for everyone. Rather, it is likely that a variety of approaches and programs can 
produce able readers. To provide information about the major types of reading approaches 
used in Alabama, fourth-grade students' reading teachers were asked to report on the 
amount of instructional emphasis they gave to six methods for teaching reading — phonics, 
integration of reading and writing, whole language, literature-based reading, reading across 
the content areas, and individualized reading programs. 



Table 12 provides the results for the extreme emphasis categories — “heavy emphasis” and 
“little or no emphasis” - for each of the six methods. According to the reading teachers: 



• In Alabama, some of the fourth-grade students (18 percent) were being 
taught by teachers who placed heavy emphasis on phonics; about half 
(47 percent) were being taught by teachers who placed heavy emphasis on 
the integration of reading and writing; and about one quarter (30 percent) 
were being taught by teachers who placed heavy emphasis on the whole 
language approach. 

• In addition, in Alabama, less than half of the fourth-grade students 
(32 percent) were being taught by teachers who placed heavy emphasis on 
literature-based reading; about half (46 percent) were being taught by 
teachers who placed heavy emphasis on reading across the content areas; 
and some (14 percent) were being taught by teachers who placed heavy 
emphasis on individualized reading programs. 

• By comparison, in Alabama, about one quarter of the fourth-grade 
students (22 percent) were being taught by teachers who placed little or 
no emphasis on phonics; relatively few (2 percent) were being taught by 
teachers who placed little or no emphasis on the integration of reading and 
writing; and some (19 percent) were being taught by teachers who placed 
little or no emphasis on the whole language approach. 

• In addition, in Alabama, some of the fourth-grade students (14 percent) 
were being taught by teachers who placed little or no emphasis on 
literature-based reading; relatively few (8 percent) were being taught by 
teachers who placed little or no emphasis on reading across the content 
areas; and less than half (42 percent) were being taught by teachers who 
placed little or no emphasis on individualized reading programs. 
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Trial State Assessment 



TABLE 12 



Teachers’ Reports on Emphasis 
Given to Specific Methods for 
Teaching Reading 



Alabama 



Southeast 



Nation 



Teacher " emphasis " categories 



Phonics 

Heavy emphasis 
Little or no emphasis 

Integration of Reading and Writing 

Heavy emphasis 

Little or no emphasis 

Whole Language 

Heavy emphasis 

Little or no emphasis 

Literature-based Reading 

Heavy emphasis 

Little or no emphasis 

Reading Across the Content Areas 

Heavy emphasis 

Little or no emphasis 

Individualized Reading Programs 

Heavy emphasis 

Little or no emphasis 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within dt 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). The percentages may not total 
100 percent because the "Moderate Emphasis” category is not included. ! Interpret with caution — the nature 
of the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate (fewer than 62 students). 



BEST C 0 PV AVAILABLE 



o 

ERIC 



73 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



67 



Alabama 



SUMMARY 



Effective teachers of reading create a literate classroom environment. They allocate an 
adequate amount of time to reading and writing, sustain children’s attention, maintain a 
brisk pace, and keep rates of success high. 26 In Alabama, the information on curricular 
and instructional content issues has revealed the following: 

• According to the schools in Alabama, 79 percent of the fourth-grade 
students were in schools where reading was identified as receiving special 
emphasis. This compares with 86 percent across the country. 

• According to the teachers in Alabama, 54 percent of the students had 
teachers who had a reading curriculum specialist available to help or advise. 
Nationally, 64 percent of the students had teachers who had a reading 
curriculum specialist available to help or advise. 

• According to the schools in Alabama, 80 percent of the students were in 
schools in which parents were used as aides in the classroom. This 
compares with 89 percent across the country. 

• In Alabama, 88 percent of the fourth-grade students had reading teachers 
who spent at least 60 minutes providing reading instruction each day. By 
comparison, 12 percent of the students had reading teachers who spent 
45 minutes or less providing reading instruction each day. 



26 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report 
of the Commission on Reading . (U.S. Department of Education: The National Institute of Education, 1985). 
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CHAPTER 4 

How Is Reading Instruction Delivered? 

Effective classroom instruction can help students become thoughtful readers. 27 The 
instructional activities that students engage in can also lead them to view reading in 
particular ways 28 and to focus on developing certain skills and strategies. To provide 
information about how instruction is delivered in Alabama, fourth-grade public-school 
students participating in the Trial State Assessment Program and their reading teachers 
were asked to report on the use of various teaching and learning activities in their reading 
classrooms. 

INSTRUCTIONAL MATERIALS FOR READING 

Basal reading programs are a traditional part of reading instruction in this country. They 
typically include a compilation of reading passages and exercises, as well as ancillary 
materials, such as workbooks and tests. These types of programs account for at least 
two-thirds of all expenditures for reading instruction and are used in more than 95 percent 
of all school districts through grade 6. 29 However, other types of reading programs may 
utilize trade books, such as story or informational books, that are not necessarily published 
for the sole purpose of reading instruction. When students encounter a variety of texts, 
they expand their general understanding of language, as well as their understanding of text 
and its underlying structures. 30 To provide information about instructional materials used 
for fourth-grade classes, students’ reading teachers were asked to report about the type of 
materials that formed the core of their reading program. Table 13 and Table A13 
(Page 142) in the Data Appendix provide the results. According to Alabama reading 
teachers: 



O 

ERJC 



27 M.A. Foertsch. Reading In and Out of School. (Washington, DC: National Center for Education Statistics, 
1992). 

28 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving From the Old to the New: Research on 
Reading Comprehension Instruction,” Renew of Educational Research, 61. (1991). 

29 Jeanne S. Chall and James R. Squire. “The Publishing Industry and Textbooks,” in R. Barr, M. Kamil, 

P. Mosenthal, and P.D. Pearson, Eds., Handbook of Reading Research, Volume II. (New York, NY: 
Longman, 1991). 

30 A. Applebee, J. Langer, and I. Mullis. Who Reads Best? (Princeton, NJ: National Assessment of 
Educational Progress, Educational Testing Service, 1988). 
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• Less than half of the fourth-grade public-school students in Alabama 
(38 percent) had reading teachers who used both basal and trade books, 
more than half (58 percent) had reading teachers who primarily used basal 
readers, and relatively few (2 percent) had reading teachers who primarily 
used trade books. 

• Less than half of the students attending schools in advantaged urban areas 
(34 percent), less than half of the students in disadvantaged urban areas 
(43 percent), about half of the students in extreme rural areas (55 percent), 
and less than half of the students in areas classified as “other” (39 percent) 
in Alabama had reading teachers who used both basal and trade books. 

• About half of the students attending schools in advantaged urban areas 
(53 percent), about half of the students in disadvantaged urban areas 
(52 percent), about half of the students in extreme rural areas (45 percent), 
and more than half of the students in areas classified as “other” 
(58 percent) in Alabama had reading teachers who primarily used basal 
readers. 

• Relatively few of the students attending schools in advantaged urban areas 
(9 percent), relatively few of the students in disadvantaged urban areas 
(2 percent), none of the students in extreme rural areas (0 percent), and 
relatively few of the students in areas classified as “other” (2 percent) in 
Alabama had reading teachers who primarily used trade books. 

• Students in Alabama whose teachers used both basal and trade books had 
about the same average reading proficiency as those whose teachers 
primarily used basal readers. 
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What type of materials form the 
core of your reading program? 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution - the nature of 
the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate (fewer than 62 students). 
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INSTRUCTIONAL RESOURCES FOR READING 



Teachers’ use of resources is obviously constrained by the availability of those resources. 
Thus, the assessed students’ teachers were asked about the extent to which they were able 
to obtain all of the instructional materials and other resources they needed. From 
Table 14 and Table A 14 (Page 144) in the Data Appendix: 

• In Alabama, 9 percent of the fourth-grade students had reading teachers 
who reported getting all of the resources they needed, while 47 percent of 
the students were taught by teachers who got only some or none of the 
resources they needed. Across the nation, these figures were 1 1 percent 
and 39 percent, respectively. 

• In Alabama, 9 percent of the students attending schools in advantaged 
urban areas, 6 percent of the students in disadvantaged urban areas, 

12 percent of the students in extreme rural areas, and 10 percent of the 
students in areas classified as “other” had reading teachers who got all of 
the resources they needed. 

• By comparison, 32 percent of the students attending schools in advantaged 
urban areas, 50 percent of the students in disadvantaged urban areas, 

38 percent of the students in extreme rural areas, and 48 percent of the 
students in areas classified as “other” in Alabama were in classrooms where 
only some or no resources were available. 

• Students in Alabama whose teachers got all of the resources they needed 
had about the same average reading proficiency as those whose teachers got 
only some or none of the resources they needed. 



THE NATION’S 
REPORT 
CARD 



1992 



IS; 



Trial State Assessment 



TABLE 14 



Teachers’ Reports on the 
Availability of Resources 



Alabama 



Southeast 



Nation 





' p ; 


■ 






Which of the following statements is true 
about how well your school system 
supplies you with the instructional 
materials and other resources you need to 
teach your class? 




Percentage 
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1 get all the resources 1 need. 

1 get most of the resources 1 need. 

1 get some or none of the resources 1 need. 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution - the nature of 
the sample does not allow accurate determination of the variability of this statistic. 
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Teachers were also asked about their use of specific types of resources that can be used to 
add depth and variety to the reading program. As indicated in Table 15: 

• In Alabama, 1 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines almost every day; 

19 percent of the students had reading teachers who used reading kits 
almost every day; 6 percent had reading teachers who used computer 
software for reading instruction almost every day; 29 percent had reading 
teachers who used a variety of books almost every day; and, finally, 

32 percent had teachers who used materials from other subject areas 
almost every day. 

• By comparison, in Alabama, 26 percent of the fourth-grade students had 
reading teachers who never or hardly ever used children’s newspapers 
and/or magazines; 41 percent of the students had reading teachers who 
never or hardly ever used reading kits; 47 percent had reading teachers who 
never or hardly ever used computer software for reading instruction; 

9 percent had reading teachers who never or hardly ever used a variety of 
books; and 12 percent had teachers who never or hardly ever used 
materials from other subject areas. 
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How often do you use the following 
resources to teach reading? 



Children’s newspapers and/or magazines 

Almost every day 

Once or twice a week 
Once or twice a month 
Never or hardly ever 

Reading kits 

Almost every day 

Once or twice a week 
Once or twice a month 
Never or hardly ever 

Computer software for reading instruction 

Almost every day 

Once or twice a week 
Once or twice a month 
Never or hardly ever 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution - the nature of 
the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate (fewer than 62 students). 
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EMPHASIS ON ASPECTS OF READING 



Expert readers use rapid decoding, large vocabularies, phonemic awareness, knowledge 
about text features, and a variety of strategies to aid comprehension and memory. 31 To 
examine the aspects of reading being emphasized in fourth-grade reading classrooms in 
Alabama, public-school students’ reading teachers were asked to report on the amount of 
instructional time they devoted to five different aspects of reading: decoding skills, oral 
reading, vocabulary, comprehension/interpretation, and reading strategies. As shown in 
Table 16, according to their reading teachers: 

• In Alabama, about one quarter of the fourth-grade students (26 percent) 
had reading teachers who devoted almost all of their instructional time in 
reading to teaching decoding skills; less than half of the students 
(33 percent) had reading teachers who devoted almost all of their 
instructional time in reading to oral reading; about half (47 percent) had 
reading teachers who devoted almost all of their instructional time in 
reading to teaching vocabulary; more than half (57 percent) had reading 
teachers who devoted almost all of their instructional time in reading to 
comprehension/interpretation; and finally, less than half (35 percent) had 
teachers who devoted almost all of their instructional time in reading to 
reading strategies. 

• By comparison, in Alabama, relatively few of the fourth-grade students 
(4 percent) had reading teachers who never or hardly ever devoted any 
instructional time to teaching decoding skills; relatively few of the students 
(2 percent) had reading teachers who never or hardly ever devoted 
instructional time to oral reading; none (0 percent) had reading teachers 
who never or hardly ever devoted their instructional time to teaching 
vocabulary; none (0 percent) had reading teachers who never or hardly 
ever devoted their time to comprehension/interpretation; and relatively few 
(1 percent) had teachers who never or hardly ever devoted their 
instructional time to reading strategies. 



1 L. Baker and A.L. Brown. “Metacognitive Skills and Reading,” in P.D. Pearson, M. Kamil, R. Barr, and 
P. Mosenthal, Eds., Handbook of Reading Research (Vol. I ). (White Plains, NY: Longman, 1984).; 

R.C. Anderson, E.H. Hiebert, J. A. Scott, and I. A.G. Wilkinson. Becoming a Nation of Readers: The Report 
of the Commission on Reading . (U.S. Department of Education: The National Institute of Education, 1985).; 
J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving From the Old to the New: Research on 
Reading Comprehension Instruction,” Review of Educational Research, 61. (1991). 
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How much of your instructional 
time in reading do you devote to 
each of the following? 

Decoding skills 

Almost all of the time 

Some of the time 
Never or hardly ever 

Oral reading 

Almost all of the time 

Some of the time 
Never or hardly ever 

Vocabulary 

Almost all of the time 

Some of the time 
Never or hardly ever 

Comprehension / Interpretation 

Almost all of the time 

Some of the time 
Never or hardly ever 

Reading strategies 

Almost all of the time 

Some of the time 
Never or hardly ever 



Percentage 
and 

Proficiency 

1 



. 



26(:3.1)V'o; 



|| 200 ,( 3 .5),,/ I 

70 { 3.4) | i ■ 

1| 211 (1.8) 

M 

33 { 3.0) . 

202 { 3.3) 

2 ( 0.9) 

*♦* 

^ 

- 

. < ' 4? ( 4.3) !«' 

203 ( 2.7) 

3 ■ 53 (4.3) 

213 ( 1.9) 

3$ o(o.o) || I 

| * p j| iff 

57 ( 3.5) 

silgosi iza^g 

I Stj 0 ( 0 . 0 ) 



. HI 3.7) Cfi.' 
204 ( 3.8) 

64 ( 3.6) #1 
| | 210(1.7) V 
1 ( 0 . 8 ) 
:***(*T.‘) 



Percentage , 

^j^^ncy 'f. 1 






::Sa: 



19 ( 3.3) 

206 ( 4.1) I 

65 ( 6.2) 
215(3.1) 

; 16 ( 4.1) 
213(6.5)! 



- . - 



30 ( 4.7) . 
213(4.6) 
66(4.1) 

213 ( 2.5) 
5(3.1) 

*** (*■*;*) 

‘"j Ij| U 

. 47(4.9) 

MM ois.o). ' . 

216(2.9) 

3(1.9) 

• ? *•*-* # •* * 

mm 

213 ( 3.9) 

'• 28 (5.4) "■ 

215(3.1)1 • 

, 0 ( 0 . 0 ) 

37(3.7) 

*#PP§jf 

I 60 ( 3.4) | 

215 

SlliliililB 



Percentage 

. 15(1.7) /; 

' . 207 ( 2.7) 

. : 69(2.5) V .. 
.218 (1.4) ,, 

15(2.1) 



feg ■ 211 (23) 

■ : 70 ( 2.3) te 

219(1-4) 

226 ( 5.4)! 

■5cv4r j; <v* ; 

mite * 

■lilllll 



issiaiiliBI 

ililioififiSl 

30 ( 2,4) 

0 { 0*0) | y ' 

' ' 





Wmt ||t# 3 )V 

I ( 0.6) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution - the nature of 
the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate (fewer than 62 students). 
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INSTRUCTIONAL ACTIVITIES 



Teachers can nurture students’ reading comprehension ability by providing instructional 
activities that prepare students for a wide variety of specific reading tasks. 32 These 
activities support students’ understanding of the text being read and model the ways in 
which students can control the process of building meaning when reading on their 
own. 33 To provide information about the instructional activities in which fourth-grade 
public-school students are engaged, the students participating in the Trial State Assessment 
Program and their reading teachers were asked to report on the frequency with which the 
teachers asked the students to do a variety of activities. The students’ and teachers’ 
responses are presented in the three following sections - workbooks, worksheets, and 
writing; discussions and group activities; and time to read. 

WORKBOOKS, WORKSHEETS, AND WRITING 



Children spend considerably more time completing workbook assignments than they do 
receiving instruction from their teachers. 34 However, analyses of workbook activities 
reveal that many of these activities require only a perfunctory level of reading. 35 Few 
workbook activities require students to do any extended writing. However, opportunities 
to write have been found to contribute to knowledge of how written and oral language are 
related, and to growth in phonics, spelling, vocabulary development, and reading 
comprehension. 3 6 

To examine the use of workbooks, worksheets, and the reading/writing connection, 
students and their reading teachers were asked about the frequency with which teachers 
asked students to work in a reading workbook or on a worksheet, to write about something 
they had read, or to write in a log or journal about what they had read. Table 17 provides 
these results. 



32 S.G. Paris. "Teaching Children to Guide Their Reading and Learning,” in Taffy E. Raphael, Ed The 
Contexts of School-Based Literacy. (New York, NY: Random House, 1984). pp. 115-130. 

33 M.A. Foertsch. Reading In and Out of School. (Washington, DC: National Center for Education Statistics, 
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34 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report 
of the Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 

J. Osborn. The Purposes, Uses, and Contents of Workbooks and Some Guidelines for Publishers/' in 
R.C. Anderson, J. Osborn, and R.J. Tierney (Eds.), Learning to Read in American Schools: Basal Readers 
and Content Texts. (Hillsdale, NJ: Erlbaum, 1984). J. Osborn. “Workbooks: Counting, Matching, and 
Judging," in J. Osborn, P.T. Wilson, and R.C. Anderson (Eds.), Reading Education: Foundations for a 
Literate America. (Lexington, MA: Lexington Books, 1985). 

36 R.J. Tierney and M. Leys. “What is the Value of Connecting Reading and Writing?" in B. Peterson, Ed 
Convergences: Essays on Reading, Writing, and Literacy. (Urbana, I L: National Council of Teachers of 
English, 1986). 
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According to the fourth-grade students: 

• More than half of the fourth-grade students in Alabama (60 percent) were 
asked to work in a reading workbook or on a worksheet almost every day 
while some (15 percent) were asked to work in a reading workbook or on 
a worksheet less than weekly. 

• In Alabama, 22 percent of the students were asked to write about 
something they have read almost every day; 44 percent were asked to do 
this less than weekly. 

• Some of the students in Alabama (16 percent) were asked to write in a log 
or journal about what they have read almost every day; more than half 
(64 percent) were given time to do this activity less than weekly. 



And, according to their reading teachers: 

• Less than half of the fourth-grade students in Alabama (37 percent) were 
asked to work in a reading workbook or on a worksheet almost every day 
while relatively few (5 percent) were asked to do these activities less than 
weekly. 

• In Alabama, 11 percent of the students were asked to write about 
something they have read almost every day; 29 percent were asked to write 
about something they have read less than weekly. 

• Some of the students in Alabama (15 percent) were asked to write in a log 
or journal about what they have read almost every day; more than half 
(60 percent) were given time to write in a log or journal less than weekly. 
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TABLE 17 



1992 

Trial State Assessment 



Teachers’ and Students’ Reports on 
Workbooks, Worksheets, and 
Writing 



Alabama 


Southeast 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 



How often do you (does 
your teacher) do each 
of the following as a 
part of reading 
instruction? 



Ask students to work in a 
reading workbook or on a 
worksheet 

Almost every day 

At least once a week 

Less than weekly 

Ask students to write about 
something they have read 

Almost every day 

At least once a week 

Less than weekly 

Ask students to write in a 
log or journal about what they 
have read 

Almost every day 

At least once a week 
Less than weekly 






Percentage' 

and 



-V : ?: ,:i' /' Xv: W-W 

ISlIifSl 

60 ( 1.4} 

25 ( 1.3) 
210 1 2.5} 
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207 ( 2.9)' 
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209 ( 7.9)1 195 (3.1)' 



11 ( 2.6) 22 (1.2) 

207.( 4.6)1 202 ( 2.4) 

60 ( 3.4) 34 ( 1.1) 

207 ( 2.3) 209 ( 2.0) 

29 ( 3.5) 44 ( 1.5) 

211 ( 3.5) 212 ( 1.9) 






|^H§.d)v 

»S;g2.9)l 

208(3.5) 

60 ( 4.3) 
208 ( 2.4) 



203 { 3.1) 

20' i 1.0) 

201 { 2 . 6 )| 

64 { 2.0) 






Percentage 
Proficiency 

" IIP 
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49 ( 5.4) 26( 2.6) 

17 ( 6.0) 18 { 2.0) 

215(14.6)! 202 ( 7.7) 

16(3.1) 

216 ( 7.3) 






23 ( 1.7) 
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214(3.4) 
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214 ( 2.6) 

44 ( 2.3) 
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218 ( 5.0) 
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212 | 3.4) 
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22 ( 1.9) 
208 ( 4.8) :. 

*459 : T2i): 
216 ( 2.3) 
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48 (.3.4) ' 

MBft -*) 219(1-8) 

22 ( 2 . 8 ) 21 ( 1 . 1 ) 
222 ( 3.4) 212(1.8) 

fl : &!)£&$$$£ M ’& 

\ . : jf . |g §|§§t||s 

25 ( 1.8) 23 ( 0.8)\ 

221 ( 2 . 8 ) 211 ( 1 . 6 ) 

49 ( 2.6) 34(1.0) 

;217 ( .1 .9) 218(1.3) 

26 ( 2.5) 43( 1.2) 

.214(2.5) 219(1.2) 

WM . ., 

1 21 

^31?@^'f!22 ( 1.0) 

f|l|)((2$)^ 

48(2.8) 57 ( 1.6) 

216j^|9) ^l2jC^p| 






The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution — the nature of 
the sample does not allow accurate determination of the variability of this statistic. 
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DISCUSSION AND GROUP ACTIVITIES 



Discussion-related activities are an important part of classroom learning, because they 
provide opportunities for students to ask questions about things they do not understand 
or want to know more about. A lack of emphasis on group work or the sharing of different 
interpretations limits opportunities students have for discovering that their reactions or 
interpretations may not be the only ones justified by the text. 37 



To examine the prevalence of discussion-related activities, students and their reading 
teachers were asked about how frequently the students were asked to discuss new or 
difficult vocabulary, to talk with each other about what they have read, or to do a group 
activity or project about what they have read. As shown in Table 18: 



According to the fourth-grade students: 

• Less than half of the fourth-grade students in Alabama (37 percent) were 
asked to discuss new or difficult vocabulary almost every day while about 
one quarter (23 percent) were asked to do this activity less than weekly. 

• In Alabama, 21 percent of the students were asked to talk with each other 
about what they have read almost every day; 54 percent were asked to do 
this less than weekly. 

• Some of the students in Alabama (12 percent) were asked to do a group 
activity or project about what they have read almost every day; more than 
half (67 percent) were given time to do this activity less than weekly. 



And, according to their reading teachers: 

• More than half of the fourth-grade students in Alabama (63 percent) were 
asked to discuss new or difficult vocabulary almost every day while none 
(0 percent) were asked to do this activity less than weekly. 

• In Alabama, 24 percent of the students were asked to talk with each other 
about what they have read almost every day; 29 percent were asked to do 
this less than weekly. 

• Relatively few of the students in Alabama (1 percent) were asked to do a 
group activity or project about what they have read almost every day; many 
(84 percent) were given time to do this activity less than weekly. 



37 J. Moffett and B. Wagner. “Student Centered Reading Activities,” English Journal, 80. 1991. 
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TABLE 18 



Teachers’ and Students’ Reports on 
the Frequency of Discussion and 
Group Activities 



Alabama 


Southeast 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 


Student 



How often do you (does 
your teacher) do each 
of the following as a 
part of reading 
instruction? 



Percentage 
and 

Proficiency 











Discuss new or difficult 


y 




X v,;./ 


vocabulary 




' \, ; : - . ■. ■ - 


:49,( 2.4) 31 ( 0.9) 

215(1.8) 216 (1.5) 


Almost every day 


63 ( 3.4) 37 ( 1.1) 

206 ( 


44 ( 3.9) 37 ( 1.6) 

212 ( 3.4) 212 ( 2.8) 


At least once a week 


37 ( 3.4) 40(1.3) 


54 ( 3.3) 35 ( 2.1) 

;214(4.0):\21^£2gp: 


,49(2.3) 39 ( 1.0) 

219 ( |H 221 ( iff)! 


Less than weekly 


0(0.0) 23(1.1) 

*” (*V) 199 ( 2.7) 


2 ( 1.8) 28 ( 1.5) 

-*• (*\*) 206 ( 3.9) 


2(0.8) 30 ( 0.8) 

219 ( 7.8)! 210 ( 1.3) 


Ask students to talk to each 


v 




* 


other about what they have read 


• • ‘ - . ' '■ . ; . . - . 






Almost every day 


24 ( 3.0) 21 (1.1) 

203(3.6) 199(2.3) 


33(3.9) 17(1.4) 

208 ( 2.5) 202 ( 3.7) 


32(2.6) 17(0,6) 

216 { 2.3) 208 ( 2,0) 

46(3.0) 28 1 0.7) 

220 216"( 1.8) 


At least once a week 


47 ( 3.7) 26 ( 1.0) 

210 (2.4) 206 ( 2.1) 


45(4.2) 29 ( 1.4) 

218 ( 5.0) 212 ( 3.5) 


Less than weekly 


29 ( 3.11 54 (1.3) 

211(2.6) 213(1.9) 


. 22 ( 4.1) 54 ( 2.0) 

212(4.7)1 215(2.9) 


19( 2.7) 55 ( 0.9) 


Ask students to do a group 








activity or project about what 








they have read 








Almost every day 


1 ( 0.6) 12 ( 0.8) 


2 ( 0,8) M ( 1.1) 

-* (**.*) 196 ( 4.4) 


3(0.8) 12(0.5) 

,221 ( 4.6)f 200 ( 2.3) 


At least once a week 


15 ( 2.5) 21 ( 0.8) 

208(4.9) 199(2.1) 


17 ( 2.9) 22 (1.4) 

211 ( 4.4) g|g|g| 


.21(2.4) 24(0.7) 

219 ( 2.4) 213 ( 1.7) 


Less than weekly 


.84 ( 2.7) 67(1.2) 

209 ( 1.8) 215(1.7) 


so (j&j) 


0.8)1 
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Proficiency 
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Proficiency 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution -- the nature of 
the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate (fewer than 62 students). 
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TIME TO READ 



Independent reading is probably a major source of reading fluency. In contrast to 
completing workbook pages or computer drills, the reading of books provides practice in 
the whole act of reading. However, the amount of time children spend reading in the 
average classroom, as well as the number of pages read for school and homework, has been 
found to be negligible. 38 



Both the fourth-grade students and their reading teachers were questioned about the 
frequency with which the teachers asked the students to read aloud or read silently, or gave 
the students time to read books of their own choosing. Table 19 provides this information. 



According to the fourth-grade students: 



• In Alabama, 53 percent of the students were asked to read aloud almost 
every day, while 20 percent were asked to read aloud less than weekly. 

• More than half of the fourth-grade students in Alabama (61 percent) were 
asked to read silently almost every day; some (12 percent) were asked to 
read silently less than weekly. 

• Less than half of the students in Alabama (43 percent) were given time to 
read books of their own choosing almost every day; about one quarter 
(25 percent) were given time to read books they had chosen less than 
weekly. 



And, according to their reading teachers: 



• In Alabama, 56 percent of the students were asked to read aloud almost 
every day, while 1 percent were asked to read aloud less than weekly. 

• More than half of the fourth-grade students in Alabama (58 percent) were 
asked to read silently almost every day; relatively few (5 percent) were 
asked to read silently less than weekly. 

• About half of the students in Alabama (50 percent) were given time to read 
books of their own choosing almost every day; some (15 percent) were 
given time to read books they had chosen less than weekly. 



38 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report 
of the Commission on Reading . (U.S. Department of Education: The’ National Institute of Education, 1985). 
M.A. Foertsch. Reading In and Out of School (Washington, DC: National Center for Education Statistics, 
1992). 
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TABLE 19 



Teachers’ and Students’ Reports on 
the Frequency of Reading in Class 



1992 

Trial State Assessment 


Alabama 


Southeast 


Nation 




Teacher 


Student 


Teacher 


Student 


Teacher 


Student 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution — the nature of 
the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate (fewer than 62 students). 



READING AND USE OF LIBRARIES 



Analysis of schools that have been successful in promoting independent reading suggest 
that one of the keys is ready access to books. 39 Libraries can be a major resource in 
developing students’ reading abilities because students can use them as quiet places to read 
as well as to check out books and to obtain reference information. Thus, to examine 
library use, students’ reading teachers were asked about the frequency with which they sent 
or took their reading classes to the library and assigned students to read a book from the 
library. 



39 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report 
of the Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 
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Table 20 and Table A20 (Page 180) in the Data Appendix provide the results from teachers’ 
reports about the frequency of sending fourth-grade students to the library: 

• Many of the students in Alabama (86 percent) had reading teachers who 
sent or took the class to the library at least once a week; relatively few 
(5 percent) had reading teachers who never or hardly ever sent or took the 
class to the library. 

• In Alabama, 92 percent of the students attending schools in advantaged 
urban areas, 88 percent of the students in disadvantaged urban areas, 

82 percent of the students in extreme rural areas, and 83 percent of the 
students in areas classified as “other” had reading teachers who sent or took 
the class to the library at least once a week. 

• By contrast, 8 percent of the students attending schools in advantaged 
urban areas, 0 percent of the students in disadvantaged urban areas, 

1 percent of the students in extreme rural areas, and 7 percent of the 
students in areas classified as “other” in Alabama had reading teachers who 
never or hardly ever sent or took the class to the library. 




Trial State Assessment 



TABLE 20 | Teachers’ Reports on Sending 

I Students to the Library 



Alabama 



Southeast 



Nation 









, . :.,r X .$«.■ - ?. 




How often do you send or take 
the class to the library? 




Percentage 

and 

■ Proficiency 

06(3.3) 

209 ( 1.8) 

9(2.0) 

109(6.8)1 

: illfi s i s) 111 

210(8.4)! 


MIMB 

Proficiency 


' Percentage 
5 Proftclenpy \ 


At least once a week 
Once or twice a month 
Never or hardly ever 


: 83 ( 5.7) . 

, 214 ( 3.7) 

. . 14(5.0) 

211 ( 8.2)1 

2 ( 1.0) 


f S . 85 ( 2.7)> * ' 
1 219 1.5 

. ' 

8 ( 1.9) ■ 

208 ( 4.2)' 

' 

209 ( 4.4)! ' 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). Percentages may not add to 100 because 
a very small percentage of teachers reported that there was no library at their school. ! Interpret with caution 
— the nature of the sample does not allow accurate determination of the variability of this statistic. *** Sample 
size is insufficient to permit a reliable estimate (fewer than 62 students). 
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Table 21 and Table A21 (Page 182) in the Data Appendix provide results about teachers’ 
reports on the frequency of assigning students to read a book from the library: 



• About half of the fourth graders in Alabama (47 percent) had reading 
teachers who assigned reading a book from the library at least once a week; 
some (14 percent) had reading teachers who never or hardly ever assigned 
reading library books. 

• More than half of the students attending schools in advantaged urban areas 
(58 percent), about three quarters of the students in disadvantaged urban 
areas (71 percent), about half of the students in extreme rural areas 
(47 percent), and less than half of the students in areas classified as “other” 
(43 percent) in Alabama had reading teachers who assigned students to 
read a book from the library at least once a week. 

• By comparison, relatively few of the students attending schools in 
advantaged urban areas (3 percent), relatively few of the students in 
disadvantaged urban areas (3 percent), less than half of the students in 
extreme rural areas (37 percent), and some of the students in areas 
classified as “other” (12 percent) in Alabama had reading teachers who 
never or hardly ever assigned students to read a book from the library. 
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TABLE 21 I Teachers’ Reports on Assigning 
I Books from the Library 



Alabama 



Southeast 



Nation 



How often do you assign 
students to read a book from 
the library? 



At least once a week 
Once or twice a month 
Never or hardly ever 



Percentage 







Proficiency 

mm * < 

4 : A 



22(5.1) i 
219 { 5.3)! 



#11 



Proficiency 

■ 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). Percentages may not add to 100 because 
a very small percentage of teachers reported that there was no library at their school. ! Interpret with caution 
- the nature of the sample does not allow accurate determination of the variability of this statistic. 
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ASSESSING PROGRESS IN READING 



According to Becoming a Nation of Readers , standardized tests do not provide a deep 
assessment of reading comprehension and should be supplemented with observations of 
reading fluency, critical analysis of lengthy reading selections, and measures of the amount 
of independent reading and writing done by children. 40 



Fourth-grade students’ reading teachers were asked a series of individual questions to report 
on how often they used different types of assessment measures — including multiple- choice 
tests, longer extended constructed-response questions, and reading portfolios -- to assess 
student progress in reading. The use of reading portfolios is a relatively new practice and 
may not be widely used in many schools as an assessment tool. From Table 22: 



• Less than half of the fourth-grade students in Alabama (32 percent) were 
assessed with multiple-choice tests once or twice a week while relatively few 
(6 percent) were never or hardly ever assessed in this manner. 

• In Alabama, 37 percent of the students were asked to write paragraphs 
about what they had read once or twice a week; 5 percent were never or 
hardly ever assessed using these extended constructed-response questions. 

• Relatively few of the students in Alabama (8 percent) were assessed by 
using reading portfolios about once or twice a week; about half 
(51 percent) were never or hardly ever asked to do this activity. 



40 R.C. Anderson, E.H. Hiebert, J.A. Scott, and l.A.G. Wilkinson. Becoming a Nation of Readers: The Report 
of the Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 
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TABLE 22 



Teachers’ Reports on Assessing 
Progress in Reading 



1M21EEB 



Trial State Assessment 



Alabama 



Southeast 



Nation 



How often do you use each of the 
following to assess student progress in 
reading? 

Multiple-choice tests 

Once or twice a week 

Once or twice a month 
Once or twice a year 
Never or hardly ever 

Writing paragraphs about what they have read 

Once or twice a week 

Once or twice a month 
Once or twice a year 
Never or hardly ever 

Reading portfolios 

Once or twice a week 

Once or twice a month 
Once or twice a year 
Never or hardly ever 



Percentage 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). ! Interpret with caution - the nature of 
the sample does not allow accurate determination of the variability of this statistic. *** Sample size is 
insufficient to permit a reliable estimate (fewer than 62 students). 
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SUMMARY 



For instruction to be most effective, subject matter, teaching materials and activities, and 
the instructional context must be carefully orchestrated to create a meaningful and 
motivating learning experience. 41 Because classroom instructional time is typically limited, 
teachers need to make the best possible use of what is known about effective instructional 
delivery practices and resources. 



• In Alabama, 38 percent of the fourth-grade public-school students had 
reading teachers who used both basal and trade books, 58 percent had 
reading teachers who primarily used basal readers, and 2 percent had 
reading teachers who primarily used trade books. 

• In Alabama, 9 percent of the fourth-grade students had reading teachers 
who reported getting all of the resources they needed, while 47 percent of 
the students were taught by teachers who got only some or none of the 
resources they needed. Across the nation, these figures were 1 1 percent 
and 39 percent, respectively. 

• In Alabama, 1 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines almost every day; 
19 percent of the students had reading teachers who used reading kits 
almost every day; 6 percent had reading teachers who used computer 
software for reading instruction almost every day; 29 percent had reading 
teachers who used a variety of books almost every day; and, finally, 
32 percent had teachers who used materials from other subject areas 
almost every day. 

• In Alabama, 26 percent of the fourth-grade students had reading teachers 
who devoted almost all of their instructional time in reading to teaching 
decoding skills; 33 percent of the students had reading teachers who 
devoted almost all of their instructional time in reading to oral reading; 
47 percent had reading teachers who devoted almost all of their 
instructional time in reading to teaching vocabulary; 57 percent had 
reading teachers who devoted almost all of their instructional time in 
reading to comprehension/interpretation; and finally, 35 percent had 
teachers who devoted almost all of their instructional time in reading to 
reading strategies. 

• Many of the students in Alabama (86 percent) had reading teachers who 
sent or took the class to the library at least once a week; relatively few 
(5 percent) had reading teachers who never or hardly ever sent or took the 
class to the library. 

• In Alabama, 47 percent of the students had reading teachers who assigned 
reading a book from the library at least once a week; 14 percent had 
reading teachers who never or hardly ever assigned reading library books. 

• In Alabama, 37 percent of the students were asked to write paragraphs 
about what they had read once or twice a week; 5 percent were never or 
hardly ever assessed using these extended constructed-response questions. 



41 J.I. Goodlad. A Place Called School: Prospects for the Future. (New York, NY: McGraw-Hill, 1984). 



o 

ERIC 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



93 



87 



Alabama 



CHAPTER 5 

Who Is Teaching Reading to Fourth Graders? 

PREPARATION AND EXPERIENCE 



Many states have begun to raise teacher certification standards and strengthen teacher 
training programs. In curriculum areas requiring special attention and improvement, such 
as reading, it is particularly important to have well-qualified teachers. To provide 
information about the staff who are teaching reading to fourth-grade students in public 
schools, the Trial State Assessment gathered details on the teachers’ educational 
backgrounds. 

Table 23 summarizes teacher responses to questions concerning their academic preparation, 
certification, and their years of elementary or secondary teaching experience: 



• In Alabama, 60 percent of the students were being taught by reading 
teachers who reported having at least a master’s or education specialist’s 
degree. This compares with 46 percent for students across the nation. 

• Some of the students (19 percent) had reading teachers who had the 
highest level of teaching certification that is recognized by Alabama. This 
is lower than the figure for the nation, where more than half of the students 
(57 percent) were taught by reading teachers who were certified at the 
highest level available in their states. 

• In Alabama, 19 percent of the fourth-grade public- school students were 
being taught reading by teachers who had an undergraduate major in 
English, reading, and/or language arts. By comparison, 22 percent of the 
students across the nation had reading teachers with the same major. 

• Relatively few of the fourth-grade public-school students in Alabama 
(9 percent) were taught reading by teachers who had a graduate major in 
English, reading, and/or language arts. Across the nation, some 
(18 percent) of the students were taught by teachers who majored in 
English, reading, and/or language arts in graduate school. 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



94 



89 



Alabama 



• In Alabama, 70 percent of the fourth-grade public-school students were 
being taught reading by teachers who have taught at either the elementary 
or secondary level for at least 11 years (including part-time teaching). 
Across the nation, 69 percent of the students had reading teachers with at 
least 11 years’ experience. 




TABLE 23 



Teachers’ Reports on Their Fields 
of Study and Teaching Experience 



Alabama 



Southeast 



Nation 
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What is the highest academic degree you hold? 
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What was your undergraduate major? 
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What was your graduate major? 
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How many years in total have you taught at 
either the elementary or secondary level? 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, 
for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see 
Appendix A for details). 
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PROFESSIONAL DEVELOPMENT 



Teachers also were asked about the amount of time they spent on in-service education 
dedicated to reading or the teaching of reading during the year immediately preceding the 
Trial State Assessment (Table 24): 

• In Alabama, 30 percent of the fourth-grade public-school students had 
reading teachers who spent at least 16 hours on in-service education 
dedicated to reading or the teaching of reading. Across the nation, 

31 percent of the students had reading teachers who spent at least that 
much time on similar types of in-service education. 

• In Alabama, 8 percent of the students had reading teachers who spent no 
time on in-service education devoted to reading or the teaching of reading. 
Nationally, 9 percent of the students had reading teachers who spent no 
time on similar in-service education. 
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TABLE 24 



Teachers’ Reports on Their 
In-Service Education 



Alabama 



Southeast 



Nation 




The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, 
for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see 
Appendix A for details). 
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Finally, teachers were asked to report on whether they had training in specific aspects of 
reading during the past five years, either in college courses or through in-service education. 
As indicated in Table 25: 



• In Alabama, 85 percent of the fourth-grade public-school students had 
reading teachers who reported that they had training in teaching critical 
thinking skills; 90 percent had reading teachers who reported having 
training in combining reading and writing; 80 percent had reading teachers 
who reported having training in the whole language approach to teaching 
reading; and 85 percent had reading teachers who reported having training 
in reading assessment. 

• Across the nation, 83 percent of the fourth-grade public-school students 
had reading teachers who reported that they had training in teaching critical 
thinking skills; 89 percent had reading teachers who reported having 
training in combining reading and writing; 80 percent had reading teachers 
who reported having training in the whole language approach to teaching 
reading; and 75 percent had reading teachers who reported having training 
in reading assessment. 




Trial State Assessment 



TABLE 25 



Teachers’ Reports on Training in 
Specific Reading Areas 



Alabama 



Southeast 



Nation 



Percentage of students whose teachers 
have had training in each of the following 
areas during the past five years 



Teaching critical thinking skills 

Combining reading and writing 

The whole language approach to 
teaching reading 

Reading assessment 




The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, 
for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate 
for the sample. In comparing two estimates, one must use the standard error of the difference (see 
Appendix A for details). 
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SUMMARY 



In recent years, accountability for educational outcomes has become an issue of increasing 
importance to federal, state, and local governments. There is no guarantee that individuals 
with a specific set of credentials will be effective teachers; however, it is likely that relevant 
training and experience do contribute to better teaching. 



The information about teachers’ educational backgrounds and experience reveals that: 

• In Alabama, 60 percent of the students were being taugjit by reading 
teachers who reported having at least a master’s or education specialist’s 
degree. This compares with 46 percent for students across the nation. 

• Some of the students (19 percent) had reading teachers who had the 
highest level of teaching certification that is recognized by Alabama. This 
is lower than the figure for the nation, where more than half of the students 
(57 percent) were taught by reading teachers who were certified at the 
highest level available in their states. 

• In Alabama, 19 percent of the fourth-grade public-school students were 
being taught reading by teachers who had an undergraduate major in 
English, reading, and/or language arts. By comparison, 22 percent of the 
students across the nation had reading teachers with the same major. 

• Relatively few of the fourth-grade public-school students in Alabama 
(9 percent) were taught reading by teachers who had a graduate major in 
English, reading, and/or language arts. Across the nation, some 
(18 percent) of the students were taught by teachers who majored in 
English, reading, and/or language arts in graduate school. 

• In Alabama, 70 percent of the fourth-grade public-school students were 
being taught reading by teachers who have taught at either the elementary 
or secondary level for at least 11 years (including part-time teaching). 
Across the nation, 69 percent of the students had reading teachers with at 
least 11 years’ experience. 

• In Alabama, 30 percent of the fourth-grade public-school students had 
teachers who spent at least 16 hours on in-service education dedicated to 
reading or the teaching of reading. Across the nation, 31 percent of the 
students had teachers who spent at least that much time on similar types 
of in-service education. By comparison, in Alabama, 8 percent of the 
students had reading teachers who spent no time on in-service education 
devoted to reading or the teaching of reading. Nationally, 9 percent of the 
students had reading teachers who spent no time on similar in-service 
education. 

• In Alabama, 85 percent of the fourth-grade public-school students had 
reading teachers who reported that they had training in teaching critical 
thinking skills; 90 percent had reading teachers who reported having 
training in combining reading and writing; 80 percent had reading teachers 
who reported having training in the whole language approach to teaching 
reading; and 85 percent had reading teachers who reported having training 
in reading assessment. 
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CHAPTER 6 

Students’ Home Support for Literacy 

Home and attitudinal variables affect students’ reading achievement. 42 In addition, good 
readers usually interact with a wide variety of materials on their own, and share their 
experiences with family and friends 43 Thus, it is important to understand students’ 
attitudes toward reading, the extent to which students read on their own, and the degree 
of home support that is available for reading. To examine these factors, students 
participating in the Trial State Assessment were asked a series of questions about 
themselves, their parents or guardians, and home factors related to reading. 



READING OUTSIDE OF SCHOOL 

Because relatively small percentages of students appear to devote little or no time to leisure 
reading, 44 students participating in the Trial State Assessment were asked to report on how 
often they read for fun on their own time (Table 26). They also were asked about the 
number of books they have read on their own outside of school during the month 
preceding the assessment (Table 27), and how often they have taken books out of the 
school library or public library for their own enjoyment (Table 28). 
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42 J.T. Guthrie and V. Greaney. “Literacy Acts,” in R. Barr, M. Kamil, P. Mosenthal, and P.D. Pearson, Eds., 
Handbook of Reading Research : Volume II. (New York, NY: Longman, 1991). 

43 M.A. Foertsch. Reading In and Out of School. (Washington, DC: National Center for Education Statistics, 
1992). 

44 L.G. Fielding, P.T. Wilson, R.C. Anderson. “A New Focus on Free Reading: The Role of Trade Books in 
Reading and Instruction,” in T. Raphael and R. Reynolds, Eds., Contexts of Literacy. (New York: Longman, 
1990); V. Greandy. “Factors Related to Amount and Type of Leisure-time Reading,” Reading Research 
Quarterly, 15(80). (1980). pp. 337-357. 
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The results are provided in Tables 26 and A26 (Page 190) regarding how often students 
reported reading for fun on their own time. 



• In Alabama, 38 percent of the fourth-grade public-school students reported 
that they read for fun almost every day while 16 percent never or hardly 
ever did so. 

• In Alabama, a smaller percentage of boys than girls read for fun almost 
every day; a greater percentage of boys than girls never or hardly ever did. 

• Less than half of the White students (37 percent), less than half of the 
Black students (41 percent), and less than half of the Hispanic students 
(37 percent) in Alabama read for fun almost every day. 

• Some of the White students (14 percent), some of the Black students 
(18 percent), and some of the Hispanic students (20 percent) in Alabama 
never or hardly ever read for fun. 
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TABLE 26 | Students’ Reports on Reading for 

I Fun 



Alabama 



Southeast 



Nation 



How often do you read for fun 
on your own time? 



Almost every day 
Once or twice a week 
Once or twice a month 
Never or hardly ever 



Percentage 


Percentage 


Percentage 
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Proficiency 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 



100 



96 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



Alabama 



Concerning how many books were read by fourth-grade students in Alabama, Table 27 
and Table A27 (Page 192) in the Data Appendix reveal that: 

• Some of the fourth-grade public-school students (11 percent) did not read 
any books on their own outside of school in the month preceding the 
assessment; less than half (40 percent) read five or more books during the 
same period. 

• A smaller percentage of males than females read five or more books on 
their own outside of school during the month prior to the assessment; a 
greater percentage of males than females read no books. 

• Less than half of the White students (39 percent), less than half of the 
Black students (43 percent), and about one quarter of the Hispanic 
students (28 percent) read five or more books on their own outside of 
school. 

• Some of the White students (11 percent), relatively few of the Black 
students (10 percent), and some of the Hispanic students (14 percent) read 
no books on their own outside of school. 

• Average reading proficiency was higher for students who read five books 
or more on their own outside of school during the month prior to the 
assessment than for students who read no books. 
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TABLE 27 



Students’ Reports on the Number of 
Books Read Outside of School in the 
Past Month 



Alabama 



Southeast 



Nation 
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During the past month , how 
many books have you read on 
your own outside of school? 
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Three or four 
Five or more 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 
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Finally, regarding the frequency of taking books out of the school library or public library 
for their own enjoyment, from Table 28 and Table A28 (Page 194) in the Data Appendix: 



• In Alabama, 15 percent of the fourth-grade public-school students took 
books out of the library for their own enjoyment almost every day; 
19 percent never or hardly ever did so. Across the nation, 15 percent took 
books out of the library for their own enjoyment almost every day and 
15 percent never or hardly ever did so. 

• About the same percentage of fourth-grade females (16 percent) as males 
(14 percent) in Alabama took books out of the library for their own 
enjoyment almost every day. 

• A smaller percentage of fourth-grade females (16 percent) than males 
(21 percent) in Alabama never or hardly ever took books out of the library 
for their own enjoyment. 

• Some of the White students (13 percent), some of the Black students 
(19 percent), and some of the Hispanic students (18 percent) in Alabama 
took books out of the library for their own enjoyment almost every day. 

• Some of the White students (18 percent), some of the Black students 
(20 percent), and some of the Hispanic students (20 percent) in Alabama 
never or hardly ever took books out of the library for their own enjoyment. 

• Students in Alabama who took books out of the library almost every day 
had a higher average reading proficiency than students who never or hardly 
ever took books out of the library for their own enjoyment. 
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TABLE 28 



Students’ Reports on Taking Books 
Out of the Library 



Alabama 



Southeast 



Nation 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 



READING IN THE HOME 

The presence of parents or siblings who model and share reading, and the availability of 
reading materials in the home are critical factors in the development of students’ 
appreciation of reading and, ultimately, their comprehension and fluency. 45 Children’s 
reading materials tend to consist of what is readily available to them. 46 Students 
participating in the Trial State Assessment were asked about the availability of newspapers, 
magazines, books, and an encyclopedia at home. They were also asked about the 
frequency with which they discussed things they read with friends and family. 



©lit available 




43 D. Taylor. Family Literacy: Young Children Learning to Read and Write. (Exeter, NH: Heinemann 
Educational Books, 1983). 

46 J. Ingham. Books and Reading Development: The Bradford Book Flood Experiment. (London: Heinemann 
Educational Books, 1981). 
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Average reading proficiency associated with having zero to two, three, or four of these types 
of materials in the home is shown in Table 29 and Table A29 (Page 196) in the Data 
Appendix. The data for Alabama reveal that: 



• Students who had all four of these types of materials in the home showed 
a higher reading proficiency than did students with zero to two types of 
materials. Across the nation, students who had all four types of materials 
showed a higher reading proficiency than did students who had zero to two 
types. 

• Less than half of the White students (33 percent), some of the Black 
students (20 percent), and some of the Hispanic students (20 percent) had 
all four types of these reading materials in their homes. 

• Less than half of the White students (32 percent), about half of the Black 
students (48 percent), less than half of the Hispanic students (43 percent) 
had zero to two types of these reading materials in their homes. 
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TABLE 29 



Students’ Reports on Types of 
Reading Materials in the Home 



Alabama 



Southeast 



Nation 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 
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Regarding the frequency of discussing with friends and family what the fourth-grade 
students read, Table 30 and Table A30 (Page 198) in the Data Appendix show 
that: 

• In Alabama, 30 percent of the fourth-grade public-school students 
discussed with friends or family what they read almost every day; 
24 percent never or hardly ever discussed what they read. Across the 
nation, 27 percent discussed with friends or family what they read almost 
every day and 24 percent never or hardly ever discussed what they read. 

• About one quarter of the White students (26 percent), less than half of the 
Black students (38 percent), and less than half of the Hispanic students 
(34 percent) in Alabama discussed with friends or family what they read 
almost every day. 

• About one quarter of the White students (25 percent), about one quarter 
of the Black students (22 percent), and less than half of the Hispanic 
students (31 percent) in Alabama never or hardly ever discussed with 
friends or family what they read. 

« Students in Alabama who discussed what they read with friends or family 
almost every day had about the same reading proficiency as students who 
never or hardly ever discussed with friends or family what they read. 



THE NATION’S 
REPORT 
CARD 

1992 

Trial State Assessment 




table 30 | Students’ Reports on Talking With 

I Friends and Family About Reading 



Alabama 



Southeast 



Nation 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 
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HOURS OF TELEVISION WATCHED PER DAY 



Many avid student readers watch a lot of television, while other children neither watch 
much television nor read. 47 However, despite these findings, television viewing has an 
effect on time given to reading — frequent television viewing limits the amount of time 
available for other activities such as reading. 48 Students participating in the Trial State 
Assessment were asked to report on the amount of television they watched each day. 
Table 31 and Table A31 (Page 200) in the Data Appendix show that, in Alabama: 

• Some of the fourth-grade public-school students (16 percent) watched one 
hour or less of television each day; about one quarter (26 percent) watched 
six hours or more. 

• A greater percentage of males than females tended to watch six or more 
hours of television daily. However, a smaller percentage of males than 
females watched one hour or less per day. 

• Some of the White students (19 percent), less than half of the Black 
students (39 percent), and less than half of the Hispanic students 
(36 percent) watched six or more hours of television each day. 

• Some of the White students (17 percent), some of the Black students 
(14 percent), and some of the Hispanic students (14 percent) watched one 
hour or less per day. 

• Average reading proficiency was lowest for students who spent six hours 
or more watching television each day. 



47 S. Neuman. "The Home Environment and Fifth-grade Students’ Leisure Reading,” Elementary School 
Journal, 83. (1986). pp. 333-343. 

48 P. Heather. Young People's Reading: A Study of the Leisure Reading of 13-13 Year Olds. (Sheffield, 
England: University of Sheffield, Center for Research on User Studies, 1981). 
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TABLE 31 



Students’ Reports on the Amount of 
Time Spent Watching Television 
Each Day 



Alabama 



Southeast 



Nation 
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How much television do you 
usually watch each day? 




Percentage 
and ; 


Percentage 

Proficiency 


Percentage 

Proficiency 


One hour or less 


16 ( 0.9) 
• 210 ( 2.6) 


is ( i.6) ; 


16(0.8) 

§|j 220 { . 1.9) ||| : 


Two hours 
Three hours 


17(0.6) 

215 ( 2.2) 

1 ' 17 ( 0.9) ' ■ 


19 ( 0.8) 
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Four to five hours 
Six hours or more 


' 25(1.0) 
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198 ( 4.4) 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It 
can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must 
use the standard error of the difference (see Appendix A for details). 



SUMMARY 



Children who grow up in environments that support reading activities develop better 
reading skills. 49 Some out-of-school factors cannot be changed, but others can be altered 
in a positive way to influence a student’s learning and motivation. Partnerships among 
students, parents, teachers, and the larger community can affect the educational 
environment in the home, resulting in more out-of- school reading and an increased value 
placed on educational achievement, among other desirable outcomes. 

The data related to out-of-school factors show that: 

* In Alabama, 38 percent of the fourth-grade public-school students reported 
that they read for fun almost every day while 16 percent never or hardly 
ever did so. 

• Some of the fourth-grade public-school students in Alabama (11 percent) 
did not read any books on their own outside of school during the month 
preceding the assessment; less than half (40 percent) read five or more 
books during the same period. 



49 Dolores Durkin. Children who Read Early . (New York: Teachers College Press, Columbia University, 



1966). 
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• In Alabama, 15 percent of the fourth-grade public-school students took 
books out of the library for their own enjoyment almost every day; 
19 percent never or hardly ever did so. Across the nation, 15 percent took 
books out of the library for their own enjoyment almost every day and 
15 percent never or hardly ever did so. 

• Students in Alabama who had four types of reading materials in the home 
(newspapers, magazines, more than 25 books, and an encyclopedia) 
showed a higher reading proficiency than did students with zero to two 
types of materials. Across the nation, students who had all four types of 
materials showed a higher reading proficiency than did students who had 
zero to two types. 

• In Alabama, 30 percent of the fourth-grade public-school students 
discussed with friends or family what they read almost every day; 
24 percent never or hardly ever discussed what they read. Across the 
nation, 27 percent discussed with friends or family what they read almost 
every day and 24 percent never or hardly ever discussed what they read. 

• Some of the fourth-grade public- school students in Alabama (16 percent) 
watched one hour or less of television each day; about one quarter 
(26 percent) watched six hours or more. Average reading proficiency in 
Alabama was lowest for students who spent six hours or more watching 
television each day. 



108 



104 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



Alabama 



APPENDIX A 



THE NATION’S 
REPORT 
CARD 



1992 



Trial State Aasaesmant 




Procedural Appendix 



This appendix provides an overview of the technical details of the 1992 Trial State 
Assessment Program in reading. It includes a discussion of the history of NAEP, the 
assessment design, the reading framework and objectives upon which the assessment was 
based, and the procedures used to analyze the results. 



A Recent History of NAEP 

The National Assessment of Educational Progress (NAEP) is a Congressionally mandated 
project of the National Center for Education Statistics (NCES) that has collected and 
reported information for nearly 25 years on what American students know and what they 
can do. It is the nation’s only ongoing, comparable, and representative assessment of 
student achievement. Its assessments are given to scientific samples of youths attending 
both public and private schools and enrolled in grades four, eight, or twelve. 

In 1988, Congress authorized a new aspect of NAEP that allowed states and territories to 
participate voluntarily in a trial state assessment, using samples representative of their own 
students, to provide state-level data comparable to the nation and each of the other 
participating jurisdictions. Pursuant to that law, in 1990, the mathematics achievement of 
eighth graders was assessed in 40 jurisdictions (states, territories, and the District of 
Columbia). The results were reported in The State of Mathematics Achievement: NAEP’s 
1990 Assessment of the Nation and the Trial Assessment of the States. (Washington, DC: 
National Center for Education Statistics, 1991). 
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Over time there have been many changes in emphasis of NAEP assessment and reporting, 
both to take advantage of new technologies and to reflect changing trends in education. 

In 1984, a new technology called Item Response Theory (IRT) made it possible to create 
“scale scores” for NAEP similar to those the public was accustomed to seeing for the 
annual Scholastic Aptitude Test (SAT). Educational Testing Service, in its role as 
Government grantee carrying out NAEP operations, devised a new way to describe 
performance against this scale, called “anchor levels.” Starting in 1984, NAEP results were 
reported by “anchor levels.” Anchor levels describe distributions of performance at selected 
points along the NAEP scale (i.e., standard deviation units). Anchor levels show how 
groups of students perform relative to each other, but not whether this performance is 
adequate. 

This 1992 reading report marks NCES’s continued attempt to shift to standards-based 
reporting of National Assessment statistics. The transition is being made now to report 
NAEP results by achievement levels.” Achievement levels describe how students should 
perform relative to a body of content reflected in the NAEP frameworks (i.e., how much 
students should know). The impetus for this shift lies in the belief that NAEP data will 
take on more meaning for the public if they show what proportion of our youth are able 
to meet standards of performance necessary for a changing world. For the 1992 reading 
assessment, an anchoring process was applied to these achievement levels in order to 
describe what students are able to do at each of these achievement levels. Chapter 1 of this 
report describes how the 1992 standards were prepared, provides examples of assessment 
questions that illustrate the reading content reflected in the descriptions of the NAEP 
achievement levels, and presents the results of student performance. 



Assessment Content 

The objectives for the assessment were developed through a consensus process managed 
by the Council of Chief State School Officers, and the items were developed through a 
similar process managed by Educational Testing Service. The development of the Trial 
State Assessment Program benefitted from the involvement of hundreds of representatives 
from State Education Agencies who attended numerous NETWORK meetings; served on 
committees, reviewed the framework, objectives, and questions; and, in general, provided 
important suggestions on all aspects of the program. 

The framework for the Trial State Assessment Program was developed using a broad-based 
consensus process, as described in the Overview to this report. 1 The reading assessment 
framework was a four-by-three matrix specifying three reading purposes: reading for 
literary experience, reading to be informed, and reading to perform a task. The reading to 
perform a task category was not evaluated and reported for grade 4. The four descriptions 
of reading stances include: Initial Understanding; Developing an Interpretation; Personal 
Reflection and Response; and Demonstrating a Critical Stance (see Figures A1 and A2). 
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Scg National Assessment Governing Board Reading Framework, for the 1992 National Assessment of 
Educational Progress. (Washington, DC: United States Department of Education, 1992) for a description of 
the frameworks and objectives. 
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FIGURE Al I Description of Reading Purposes 



Reading involves an interaction between a specific type of text or written material and a 
reader who typically has a purpose for reading that is related to the type of text and the 
context of the reading situation. The 1992 NAEP reading assessment presented three types 
of text to students representing each of three reading purposes: literary text for literary 
experience, informational text to gain mformation, and documents to perform a task. At 
grade 4, only the first two reading purposes were assessed. Students’ reading abilities were 
evaluated in terms of a single purpose for each type of text. 




Trial State Assessment 



Reading for Literary Experience 



Reading for literary experience involves reading literary text to explore the human condition, to relate 
narrative events with personal experience, and to consider the interplay in the selection among emotions, 
events, and possibilities. Students in the NAEP reading assessment were provided with a wide variety of 
literary text such as short stories, poems, fables, historical fiction, science fiction, and mysteries. 



Reading to Gain Information 



Reading to gain information involves reading informative passages in order to obtain some general or 
specific information. This often requires a more utilitarian approach to reading that requires the use of 
certain reading/thinking strategies different from those used for other purposes. In addition, reading to 
gain information often involves reading and interpreting adjunct aids such as charts, graphs, maps, and 
tables that provide supplemental or tangential data. Informational passages in the NAEP reading 
assessment included biographies, science articles, encyclopedia entries, primary and secondary historical 
accounts, and newspaper editorials. 



Reading to Perform a Task 



Reading to perform a task involves reading various types of materials for the purpose of applying the 
information or directions in completing a specific task. The reader’s purpose for gaining meaning extends 
beyond understanding the text to include the accomplishment of a certain activity. Documents requiring 
students in the NAEP reading assessment to perform a task included directions for creating a time capsule, 
instructions on how to write a letter to your Senator, a bus schedule, and a tax form. In 1992, reading to 
perform a task was assessed only at grades 8 and 12. 
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figure A2 | Description of Reading Stances 




Trial State Assessment 



Readers interact with text in various ways as they use background knowledge and 
understanding of text to construct, extend, and examine meaning. The NAEP reading 
assessment framework specified four reading stances to be assessed that represent various 
interactions between readers and texts. These stances are not meant to describe a hierarchy 
of skills or abilities. Rather, they are intended to describe behaviors that readers at all 
developmental levels should exhibit. 



Initial Understanding 



Initial understanding requires a broad, preliminary construction of an understanding of the text. Questions 
testing this aspect ask the reader to provide an initial impression or unreflected understanding of what was 
read. In the 1992 NAEP reading assessment, the first question following a passage was usually one testing 
initial understanding. 



Developing an Interpretation 



Developing an interpretation requires the reader to go beyond the initial impression to develop a more 
complete understanding of what was read. Questions testing this aspect require a more specific 
understanding of the text and involve 'linking information across parts of the text as well as focusing on 
specific information. 



Personal Reflection and Response 



Personal response requires the reader to connect knowledge from the text more extensively with his or her 
own personal background knowledge and experience. The focus is on how the text relates to personal 
experience, and questions on this aspect ask the readers to reflect and respond from a personal 
perspective. For the 1992 NAEP reading assessment, personal response questions were typically 
formatted as constructed-response items to allow for individual possibilities and varied responses. 



Demonstrating a Critical Stance 



Demonstrating a critical stance requires the reader to stand apart from the text, consider it, and judge it 
objectively. Questions on this aspect require the reader to perform a variety of tasks such as critical 
evaluation, comparing and contrasting, applications to practical tasks, and understanding the impact of such 
text features as irony, humor, and organization. These questions focus on the reader as interpreter/critic 
and require reflection and judgments to be made by the reader. 
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Assessment Design 

The 1992 reading assessment was based on a focused balanced incomplete block (BIB) 
spiral matrix design - a design that enables broad coverage of reading content while 
minimi7ing the burden for any one student. The 1992 NAEP reading assessment for 
grades 4, 8, and 12 contained a total of 170 discrete constructed-response items, 135 of 
which were regular constructed-response items and 35 of which were extended 
constructed-response items. 

In the Trial State reading assessment at grade 4, 85 reading items were developed for the 
assessment, including 35 regular constructed-response items, eight extended 
constructed-response items, and 42 multiple-choice items. 

The first step in implementing the BIB design required selecting grade-appropriate passages 
and developing questions to assess the four reading stances specified in the framework. 

The questions were assembled into units called blocks, with each block designed to be 
completed in 25 or 50 minutes. At grade 4, eight blocks Were designed; they required 
25 minutes of student time for completion. The blocks were assembled into assessment 
booklets so that each booklet contained three background questionnaires - the first 
consisting of general background questions, the second comprising reading background 
questions, and the third containing questions about the students’ motivation to do well in 
the assessment - and two blocks of cognitive reading items. The questions in the first 
section were read aloud to the students, usually taking about 10 minutes to complete. 
Students were then given 50 minutes to complete two 25-minute blocks of reading items, 
five minutes to complete the second background questionnaire, and three minutes to 
complete the third background questionnaire. Thus, the assessment required slightly over 
one hour of student time. 

In accordance with the BIB design, the blocks were assigned to the assessment booklets so 
that there were a total of 16 booklets at grade 4. Blocks appeared in both positions within 
a booklet and were paired with blocks assessing the same purpose for reading as well as 
blocks assessing other purposes. The booklets were spiraled or interleaved in a systematic 
sequence so that each booklet appeared an appropriate number of times in the sample. 
The students within an assessment session were assigned booklets in the order in which the 
booklets were spiraled. Thus, students in any given session received a variety of different 
booklets and only a small number of students in the session received the same booklet. 
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Data Analysis and Scales 

Once the assessments were conducted and information from the assessment booklets had 
been compiled in a database, the assessment data were weighted to match known 
population proportions and adjusted for nonresponse. Analyses were then conducted to 
determine the percentages of students who gave various responses to each cognitive and 
background question. 

Item response theory (IRT) was used to estimate average reading proficiency for each 
jurisdiction and for various subpopulations, based on students’ performance on the set of 
reading items they received. IRT provides a common scale on which performance can be 
reported for the nation, each jurisdiction, and subpopulations, even when all students do 
not answer the same set of questions. This common scale makes it possible to report on 
relationships between students’ characteristics (based on their responses to the background 
questions) and their overall performance on the assessment. 

A scale ranging from 0 to 500 was created to report performance for each of the two reading 
purposes at grade 4 (reading for literary experience and reading to gain information). The 
scales summarize examinee performance across all three item types used in the assessment 
(multiple-choice, regular constructed-response, and extended constructed-response). In 
producing the scales, three distinct IRT models were used. Multiple-choice items were 
scaled using the three-parameter logistic model; regular constructed-response items were 
scaled using the two-parameter logistic model; and the extended constructed-response items 
were scaled using a generalized partial-credit model. Each reading purpose scale was based 
on the distribution of student performance across the grades assessed in the 1992 national 
assessment (grades 4, 8, and 12) and had a mean of 250 and a standard deviation of 50. 

A composite scale was created as an overall measure of students’ reading proficiency. At 
grade 4, the composite scale was a weighted average of the two reading purpose scales, 
where the weight for each reading purpose was proportional to the relative importance 
assigned to that purpose in the specifications developed by the Reading Objectives Panel 
(55 percent literary experience and 45 percent gain information). 



Questionnaires for Teachers and Schools 

As part of the Trial State Assessment, questionnaires were given to the reading teachers of 
assessed students and to the principal or other administrator in each participating school. 

A Background Panel drafted a set of issues and guidelines and made recommendations 
concerning the design of these questionnaires. For the 1992 assessment, the teacher and 
school questionnaires focused on five educational areas: instructional content, instructional 
practices and experiences, teacher characteristics, school conditions and context, and 
conditions beyond school (i.e., home support, out-of-school activities, and attitudes). 
Similar to the development of the materials given to students, the guidelines and the teacher 
and school questionnaires were prepared through an iterative process that involved 
extensive development, field testing, and review by external advisory groups. 
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It is important to note that in this report, as in all NAEP reports, the student is always the 
unit of analysis, even when information from the teacher or school questionnaire is being 
reported. Having the student as the unit of analysis makes it possible to describe the 
instruction received by representative samples of fourth-grade students in public schools. 
Although this approach may provide a different perspective from that which would be 
obtained by simply collecting information from a sample of fourth-grade reading teachers 
or from a sample of schools, it is consistent with NAEP’s goal of providing information 
about the educational context and performance of students. 



READING TEACHER QUESTIONNAIRE 

The questionnaires for fourth-grade teachers consisted of two parts. The first requested 
information about the teacher, such as race/ethnicity and gender, as well as academic 
degrees held, teaching certification, training in reading, and ability to get instructional 
resources. In the second part, teachers were asked to provide information on each class 
they taught that included one or more students who participated in the Trial State 
Assessment Program. The information included, among other things, the extent to which 
worksheets or workbooks were used, the emphasis placed on different reading skills, and 
various instructional approaches. Because of the nature of the sampling for the Trial State 
Assessment, the responses to the reading teacher questionnaire do not necessarily represent 
all fourth-grade reading teachers in a state or territory. Rather, they represent the teachers 
of the particular students being assessed. 



SCHOOL CHARACTERISTICS AND POLICIES QUESTIONNAIRE 

An extensive school questionnaire was completed by principals or other administrators in 
the schools participating in the Trial State Assessment. In addition to questions about the 
individuals who completed the questionnaires, there were questions about school policies, 
course offerings, and special priority areas, among other topics. 



Estimating Variability 

The statistics reported by NAEP (average proficiencies, percentages of students at or above 
particular achievement levels, and percentages of students responding in certain ways to 
background questions) are estimates of the corresponding information for the population 
of fourth-grade students in public schools in a state. These estimates are based on the 
performance of carefully selected, representative samples of fourth-grade public-school 
students from the state or territory. 

If a different representative sample of students were selected and the assessment repeated, 
it is likely that the estimates might vary somewhat, and both of these sample estimates 
might differ somewhat from the value of the mean or percentage that would be obtained 
if every fourth-grade public-school student in the state or territory were assessed. Virtually 
all statistics that are based on samples (including those in NAEP) are subject to a certain 
degree of uncertainty. The uncertainty attributable to using samples of students is referred 
to as sampling error. 



115 



THE 1992 NAEP TRIAL STATE ASSESSMENT 



111 



Alabama 



Like almost all estimates based on assessment measures, NAEP’s total group and subgroup 
proficiency estimates are subject to a second source of uncertainty, in addition to sampling 
error. As previously noted, each student who participated in the Trial State Assessment 
was administered a subset of questions from the total set of questions. If each student had 
been administered a different, but equally appropriate, set of the assessment questions — 
or the entire set of questions — somewhat different estimates of total group and subgroup 
proficiency might have been obtained. Thus, a second source of uncertainty arises because 
each student was administered a subset of the total pool of questions. 

In addition to reporting estimates of average proficiencies, proportions of students at or 
above particular achievement levels, and proportions of students giving various responses 
to background questions, this report also provides estimates of the magnitude of the 
uncertainty associated with these statistics. These measures of the uncertainty are called 
standard errors and are given in parentheses in each of the tables in the report. The 
standard errors of the estimates of reading proficiency statistics reflect both sources of 
uncertainty discussed above. The standard errors of the other statistics (such as the 
proportion of students answering a background question in a certain way or the proportion 
of students in certain racial/ethnic groups) reflect only sampling error. NAEP uses a 
methodology called the jackknife procedure to estimate these standard errors. 

The reader is reminded that, as in all surveys, NAEP results are also subject to other kinds 
of errors including the effects of necessarily imperfect adjustment for student and school 
nonresponse and other largely unknowable effects associated with the particular 
instrumentation and data collection methods used. Nonsampling errors can be attributed 
to a number of sources: inability to obtain complete information about all selected 
students in all selected schools in the sample (some students or schools refused to 
participate, or students participated but answered only certain items); ambiguous 
definitions; differences in interpreting questions; inability or unw illing ness to give correct 
information; mistakes in recording, coding, or scoring data; and other errors of collecting, 
processing, sampling, and estimating missing data. The extent of nonsampling errors is 
difficult to estimate. By their nature, the impact of such errors cannot be reflected in the 
data-based estimates of uncertainty provided in NAEP reports. 



Drawing Inferences from the Results 

One of the goals of the Trial State Assessment Program is to make inferences about the 
overall population of fourth-grade students in public schools in each participating state and 
territory based on the particular sample of students assessed. The results from the sample 
— taking into account the uncertainty associated with all samples — are used to make 
inferences about the population. 

The use of confidence intervals, based on the standard errors, provides a way to make 
inferences about the population means and proportions in a manner that reflects the 
uncertainty associated with the sample estimates. An estimated sample mean proficiency 
± 2 standard errors approximates a 95 percent confidence interval for the corresponding 
population quantity . This means that with approximately 95 percent confidence, the 
average performance of the entire population of interest (e.g., all fourth-grade students in 
public schools in a state or territory) is within ± 2 standard errors of the sample mean. 
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As an example, suppose that the average reading proficiency of the students in a particular 
state’s fourth-grade sample were 256 with a standard error of 1.2. A 95 percent confidence 
interval for the population quantity would be as follows: 

Mean ± 2 standard errors — 256 ± 2 • ( 1 .2) — 256 ± 2.4 = 

256 - 2.4 and 256 + 2.4 = (253.6, 258.4) 

Thus, one can conclude with 95 percent confidence that the average proficiency for the 
entire population of fourth-grade students in public schools in that state is between 253.6 
and 258.4. 

Similar confidence intervals can be constructed for percentages, provided that the 
percentages are not extremely large (greater than 90 percent) or extremely small (less than 
10 percent ). For extreme percentages, confidence intervals constructed in the above 
manner may not be appropriate and procedures for obtaining accurate confidence intervals 
are quite complicated. 



Analyzing Subgroup Differences in Proficiencies and Proportions 

In addition to the overall results, this report presents outcomes separately for a variety of 
im portant subgroups. Many of these subgroups are defined by shared characteristics of 
students, such as their gender, race/ethnicity, and the type of community in which their 
school is located. Other subgroups are defined by students’ responses to background 
questions. Still other subgroups are defined by the responses of the assessed students’ 
reading teachers to questions in the reading teacher questionnaire. 

In Chapter 1 of this report, differences between the state and nation were tested for overall 
reading proficiency, percent of students at or above the Proficient level, and for each of the 
purposes for reading. In Chapter 2, significance tests were conducted for the overall 
proficiency for each of the subpopulations, as well as percent of students at or above the 
Proficient level for males and females. In Chapters 3-6, comparisons were made across 
subgroups for responses made to various background questions. 

As an example, consider the question: Do students who reported reading three or four books 
outside of school each month exhibit higher average reading proficiency than students who 
reported reading no books outside of school? 

To answer the question posed above, begin by comparing the average reading proficiency 
for the two groups being analyzed. If the mean for the group that reported reading three 
or four books outside of school is higher, it may be tempting to conclude that that group 
does have higher achievement than the group that reported reading no books outside of 
school. However, even though the means differ, there may be no real difference in 
performance between the two groups in the population because of the uncertainty 
associated with the estimated average proficiency of the groups in the sample. Remember 
that the intent is to make a statement about the entire population, not about the particular 
sample that was assessed. The data from the sample are used to make inferences about the 
population as a whole. 
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